2024-04-26T00:37:33.069 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T00:37:33.070 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} --archive /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945 --name teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/orig.config.yaml 2024-04-26T00:37:33.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T00:37:33.185 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945 branch: squid description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} email: ceph-qa@ceph.com first_in_suite: false job_id: '7673945' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mgr ttl cache expire seconds: 5 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 seed: 9886 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 30270/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFrdAeTv9oVh8Z2IaQmxxOQEA/3rXIk+NQIHiPIiKWJ09SejkJs8SywxNvVkqweOIAKkXAQ608e8w12rC5XWHog= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrWsmlqwLkORRO6ttno8atrloJWpgz4TJB/Rvd02tUR2SvHKwfddxbJ4SyUZe8LcUObYMbZQ1cdBHTZvhuNkEM= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - replacing it with standby - No standby daemons available - \(POOL_APP_NOT_ENABLED\) wait-for-scrub: false - workunit: clients: client.0: - mgr/test_localpool.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:00:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T00:37:33.186 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-26T00:37:33.186 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-26T00:37:33.186 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T00:37:33.188 INFO:teuthology.task.internal:Checking packages... 2024-04-26T00:37:33.213 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-26T00:37:33.213 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T00:37:33.214 INFO:teuthology.packaging:ref: None 2024-04-26T00:37:33.214 INFO:teuthology.packaging:tag: None 2024-04-26T00:37:33.214 INFO:teuthology.packaging:branch: squid 2024-04-26T00:37:33.214 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-26T00:37:33.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-26T00:37:33.419 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2447-gb22e2ebd-1jammy 2024-04-26T00:37:33.421 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T00:37:33.430 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T00:37:33.431 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T00:37:33.446 INFO:teuthology.task.internal:Saving configuration 2024-04-26T00:37:33.461 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T00:37:33.469 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T00:37:33.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 00:31:52.657807', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFDo+vu1kL5frKF8H8OEYE7ACxjCPyqFl2gqQouBEbrq'} 2024-04-26T00:37:33.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 00:31:52.659339', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFRVNCfpeg4D7+JXlcyLge1nCHwaLFn606FqiUKKEx70'} 2024-04-26T00:37:33.511 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T00:37:33.522 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2024-04-26T00:37:33.522 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2024-04-26T00:37:33.522 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T00:37:33.611 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3790e82280>, signals=[15]) 2024-04-26T00:37:33.611 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T00:37:33.617 INFO:teuthology.task.internal:Opening connections... 2024-04-26T00:37:33.618 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-04-26T00:37:33.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:37:33.705 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:37:33.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:37:33.787 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T00:37:33.798 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-04-26T00:37:33.806 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-04-26T00:37:33.807 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-04-26T00:37:33.854 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-04-26T00:37:33.855 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T00:37:33.855 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T00:37:33.855 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T00:37:33.855 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T00:37:33.855 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-04-26T00:37:33.855 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-26T00:37:33.878 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-04-26T00:37:33.883 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-04-26T00:37:33.883 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-26T00:37:33.928 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T00:37:33.929 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T00:37:33.930 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-04-26T00:37:33.930 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-26T00:37:33.952 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T00:37:33.962 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T00:37:33.979 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T00:37:33.980 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-04-26T00:37:33.983 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-04-26T00:37:33.987 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T00:37:33.999 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T00:37:34.000 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-04-26T00:37:34.031 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-04-26T00:37:34.048 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T00:37:34.098 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T00:37:34.117 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T00:37:34.117 INFO:teuthology.task.kernel:config {'mgr.x': {'kdb': 1, 'sha1': 'distro'}, 'mgr.y': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T00:37:34.117 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T00:37:34.118 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T00:37:34.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:37:34.123 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-04-26T00:37:34.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:37:34.124 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-26T00:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-56-generic 2024-04-26T00:37:34.174 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.15.0-56-generic 2024-04-26T00:37:34.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-04-26T00:37:34.176 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-56-generic 2024-04-26T00:37:34.176 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.15.0-56-generic 2024-04-26T00:37:34.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-04-26T00:37:34.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-04-26T00:37:34.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-26T00:37:34.468 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:37:34.468 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T00:37:34.476 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T00:37:34.589 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:37:34.591 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T00:37:34.648 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T00:37:34.659 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T00:37:34.725 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T00:37:34.818 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T00:37:34.893 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T00:37:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T00:37:35.004 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T00:37:35.004 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T00:37:35.006 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T00:37:35.011 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T00:37:35.013 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T00:37:35.060 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T00:37:35.069 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T00:37:35.080 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T00:37:35.081 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T00:37:35.082 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T00:37:35.150 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T00:37:35.151 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T00:37:35.151 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T00:37:35.164 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T00:37:35.165 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T00:37:35.175 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T00:37:35.178 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T00:37:35.179 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T00:37:35.179 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T00:37:35.180 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T00:37:35.181 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T00:37:35.200 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T00:37:35.207 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T00:37:35.207 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T00:37:35.223 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T00:37:35.232 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T00:37:35.234 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T00:37:35.237 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T00:37:35.237 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T00:37:35.238 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T00:37:35.265 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T00:37:35.265 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T00:37:35.266 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T00:37:35.267 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T00:37:35.299 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T00:37:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T00:37:35.301 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T00:37:35.301 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T00:37:35.301 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T00:37:35.436 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T00:37:35.453 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T00:37:35.462 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T00:37:35.463 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T00:37:35.463 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T00:37:35.464 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T00:37:35.501 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T00:37:35.519 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T00:37:35.519 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T00:37:35.521 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T00:37:35.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T00:37:35.585 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T00:37:35.585 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T00:37:35.585 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T00:37:35.591 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T00:37:35.600 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T00:37:35.755 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T00:37:35.773 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T00:37:36.178 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T00:37:36.183 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T00:37:36.198 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T00:37:36.198 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T00:37:36.201 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T00:37:36.342 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T00:37:36.453 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T00:37:36.473 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T00:37:36.474 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T00:37:36.475 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T00:37:36.479 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T00:37:36.479 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T00:37:36.479 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T00:37:36.483 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T00:37:36.488 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T00:37:36.653 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T00:37:36.736 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T00:37:36.837 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T00:37:36.870 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T00:37:36.922 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T00:37:41.035 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 13.2 MB in 2s (6,296 kB/s) 2024-04-26T00:37:41.250 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 13.2 MB in 3s (5,220 kB/s) 2024-04-26T00:37:42.432 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:37:42.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T00:37:42.514 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:37:42.600 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:37:42.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T00:37:42.669 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:37:42.718 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-04-26T00:37:42.718 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-04-26T00:37:42.848 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-26T00:37:42.848 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-26T00:37:42.900 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:37:42.900 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:37:42.900 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:37:42.901 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:37:42.901 INFO:teuthology.orchestra.run.smithi006.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T00:37:42.901 INFO:teuthology.orchestra.run.smithi006.stdout: python2.7-minimal 2024-04-26T00:37:42.901 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:37:42.902 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-04-26T00:37:42.902 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T00:37:42.902 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T00:37:42.903 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T00:37:42.904 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-04-26T00:37:42.904 INFO:teuthology.orchestra.run.smithi006.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T00:37:42.904 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-04-26T00:37:42.904 INFO:teuthology.orchestra.run.smithi006.stdout: thermald 2024-04-26T00:37:42.954 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-04-26T00:37:42.954 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T00:37:42.954 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T00:37:42.954 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T00:37:42.955 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2024-04-26T00:37:42.956 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T00:37:43.003 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:37:43.003 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:37:43.003 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:37:43.004 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:37:43.004 INFO:teuthology.orchestra.run.smithi188.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T00:37:43.004 INFO:teuthology.orchestra.run.smithi188.stdout: python2.7-minimal 2024-04-26T00:37:43.004 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:37:43.005 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-04-26T00:37:43.005 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T00:37:43.005 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T00:37:43.006 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T00:37:43.007 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-04-26T00:37:43.007 INFO:teuthology.orchestra.run.smithi188.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T00:37:43.007 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-04-26T00:37:43.007 INFO:teuthology.orchestra.run.smithi188.stdout: thermald 2024-04-26T00:37:43.049 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-04-26T00:37:43.049 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T00:37:43.049 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T00:37:43.050 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T00:37:43.050 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages will be upgraded: 2024-04-26T00:37:43.051 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T00:37:43.108 INFO:teuthology.orchestra.run.smithi188.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T00:37:43.108 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 113 MB of archives. 2024-04-26T00:37:43.108 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T00:37:43.108 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T00:37:43.137 INFO:teuthology.orchestra.run.smithi006.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T00:37:43.137 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 113 MB of archives. 2024-04-26T00:37:43.137 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T00:37:43.137 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T00:37:43.653 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T00:37:43.913 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T00:37:44.528 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T00:37:44.856 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T00:37:44.979 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T00:37:44.979 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T00:37:44.979 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T00:37:45.110 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T00:37:45.133 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T00:37:45.509 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 113 MB in 2s (54.6 MB/s) 2024-04-26T00:37:45.672 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T00:37:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T00:37:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T00:37:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T00:37:47.496 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T00:37:47.550 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T00:37:47.698 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T00:37:47.703 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:47.895 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:47.971 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-04-26T00:37:48.138 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T00:37:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T00:37:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:50.198 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T00:37:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:50.289 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:50.393 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T00:37:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:50.784 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:52.637 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T00:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:52.750 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:53.256 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T00:37:53.277 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:37:53.315 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:37:57.422 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:37:57.563 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:37:57.904 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:37:58.017 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:37:58.312 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T00:37:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T00:37:58.385 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T00:38:00.051 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:38:00.159 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:38:00.452 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:38:00.571 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:38:00.875 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T00:38:00.897 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T00:38:00.941 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T00:38:04.432 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T00:38:04.468 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:38:04.506 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:06.888 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T00:38:06.925 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T00:38:06.963 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:07.134 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:38:07.261 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:38:07.603 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T00:38:07.733 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:07.859 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T00:38:07.987 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:09.314 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:09.314 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:09.314 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:09.314 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:09.481 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T00:38:10.008 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T00:38:10.968 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T00:38:11.042 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:11.089 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:11.215 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T00:38:11.343 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:12.434 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T00:38:12.560 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T00:38:12.670 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:12.726 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T00:38:12.726 INFO:teuthology.orchestra.run.smithi188.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:12.829 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:14.273 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:16.141 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T00:38:16.583 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T00:38:16.710 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T00:38:16.777 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T00:38:16.778 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:26.719 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T00:38:26.719 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub' 2024-04-26T00:38:26.736 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T00:38:26.760 INFO:teuthology.orchestra.run.smithi188.stdout:Generating grub configuration file ... 2024-04-26T00:38:27.096 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:27.116 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:27.487 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:27.493 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:27.562 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T00:38:27.568 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T00:38:27.737 INFO:teuthology.orchestra.run.smithi188.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T00:38:27.737 INFO:teuthology.orchestra.run.smithi188.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T00:38:27.737 INFO:teuthology.orchestra.run.smithi188.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T00:38:27.782 INFO:teuthology.orchestra.run.smithi188.stdout:done 2024-04-26T00:38:28.209 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-04-26T00:38:28.232 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.105.102 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-04-26T00:38:28.233 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-04-26T00:38:28.233 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T00:38:28.233 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T00:38:28.233 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T00:38:28.234 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2024-04-26T00:38:28.234 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T00:38:28.234 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-04-26T00:38:28.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-26T00:38:28.509 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:38:28.520 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T00:38:28.524 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T00:38:28.544 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T00:38:29.799 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:38:29.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T00:38:29.869 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:38:30.046 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-26T00:38:30.047 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-26T00:38:30.207 INFO:teuthology.orchestra.run.smithi188.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T00:38:30.207 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:38:30.207 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:38:30.207 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:38:30.208 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:38:30.208 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T00:38:30.208 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T00:38:30.208 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:38:30.247 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T00:38:30.248 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-04-26T00:38:30.305 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.105.102 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-04-26T00:38:30.306 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-04-26T00:38:30.306 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-04-26T00:38:30.353 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.wfvgoGokxT 2024-04-26T00:38:30.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wfvgoGokxT 2024-04-26T00:38:30.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.wfvgoGokxT 2024-04-26T00:38:30.532 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.wfvgoGokxT is 10KB 2024-04-26T00:38:30.545 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.wfvgoGokxT 2024-04-26T00:38:30.551 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T00:38:30.609 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:38:30.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T00:38:30.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T00:38:30.689 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T00:38:30.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo update-grub 2024-04-26T00:38:31.309 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T00:38:31.310 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub' 2024-04-26T00:38:31.316 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T00:38:31.343 INFO:teuthology.orchestra.run.smithi006.stdout:Generating grub configuration file ... 2024-04-26T00:38:31.821 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:31.841 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:31.885 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub' 2024-04-26T00:38:31.886 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T00:38:31.888 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-04-26T00:38:32.142 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:32.148 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:32.242 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:32.248 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:32.322 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T00:38:32.327 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T00:38:32.457 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:32.463 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:32.488 INFO:teuthology.orchestra.run.smithi006.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T00:38:32.488 INFO:teuthology.orchestra.run.smithi006.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T00:38:32.488 INFO:teuthology.orchestra.run.smithi006.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T00:38:32.505 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T00:38:32.510 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T00:38:32.534 INFO:teuthology.orchestra.run.smithi006.stdout:done 2024-04-26T00:38:32.635 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T00:38:32.635 INFO:teuthology.orchestra.run.smithi188.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T00:38:32.635 INFO:teuthology.orchestra.run.smithi188.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T00:38:32.657 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-04-26T00:38:32.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-04-26T00:38:33.022 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-04-26T00:38:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-04-26T00:38:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-04-26T00:38:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-04-26T00:38:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-04-26T00:38:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.105.102 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-04-26T00:38:33.046 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-04-26T00:38:33.046 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T00:38:33.047 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T00:38:33.047 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T00:38:33.047 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-26T00:38:33.047 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T00:38:33.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-04-26T00:38:33.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-04-26T00:38:33.597 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T00:38:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:38:33.704 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T00:38:33.799 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T00:38:35.040 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:38:35.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T00:38:35.120 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:38:35.329 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-04-26T00:38:35.330 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-04-26T00:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T00:38:35.519 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T00:38:35.520 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:38:35.561 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T00:38:35.563 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.105.102 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T00:38:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-04-26T00:38:35.581 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-04-26T00:38:35.581 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-04-26T00:38:35.581 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-04-26T00:38:35.581 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-04-26T00:38:35.627 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Ao0uDpswGk 2024-04-26T00:38:35.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ao0uDpswGk 2024-04-26T00:38:35.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.Ao0uDpswGk 2024-04-26T00:38:35.803 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.Ao0uDpswGk is 10KB 2024-04-26T00:38:35.817 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.Ao0uDpswGk 2024-04-26T00:38:35.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T00:38:35.880 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:38:35.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T00:38:35.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T00:38:35.949 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T00:38:35.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo update-grub 2024-04-26T00:38:37.302 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2024-04-26T00:38:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T00:38:37.308 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-04-26T00:38:37.481 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T00:38:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T00:38:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T00:38:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T00:38:37.802 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T00:38:37.808 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T00:38:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T00:38:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T00:38:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T00:38:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-04-26T00:38:37.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-04-26T00:39:02.690 INFO:teuthology.task.kernel:Checking client mgr.y for new kernel version... 2024-04-26T00:39:02.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:39:02.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:39:07.990 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-26T00:39:07.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:39:07.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:39:21.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-26T00:39:26.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-26T00:39:30.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:39:30.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:39:33.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-26T00:39:35.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:39:35.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:39:45.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:39:45.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:40:16.900 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-26T00:40:17.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:40:17.474 INFO:teuthology.task.kernel:Checking kernel version of mgr.y, want "5.15.0-105-generic"... 2024-04-26T00:40:17.474 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-26T00:40:17.479 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-105-generic 2024-04-26T00:40:17.479 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T00:40:17.480 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T00:40:17.480 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T00:40:18.480 INFO:teuthology.task.kernel:Enabling kdb on mgr.y... 2024-04-26T00:40:18.481 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T00:40:18.560 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-04-26T00:40:18.582 DEBUG:teuthology.parallel:result is None 2024-04-26T00:40:35.502 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T00:40:47.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:40:47.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:40:47.804 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-26T00:40:48.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:40:48.519 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-105-generic"... 2024-04-26T00:40:48.519 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-04-26T00:40:48.567 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-105-generic 2024-04-26T00:40:48.567 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T00:40:48.568 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T00:40:48.568 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T00:40:49.568 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-26T00:40:49.568 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T00:40:49.645 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-04-26T00:40:49.669 DEBUG:teuthology.parallel:result is None 2024-04-26T00:40:49.669 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T00:40:49.678 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T00:40:49.678 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T00:40:49.681 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T00:40:49.688 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T00:40:49.696 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T00:40:49.708 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T00:40:49.708 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T00:40:49.728 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T00:40:49.748 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T00:40:49.755 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T00:40:49.756 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T00:40:49.784 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T00:40:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T00:40:49.805 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T00:40:49.806 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T00:40:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T00:40:49.815 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T00:40:49.823 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T00:40:49.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T00:40:49.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T00:40:49.868 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T00:40:49.885 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T00:40:49.885 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T00:40:49.908 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T00:40:49.917 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T00:40:49.960 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T00:40:50.007 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:40:50.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T00:40:50.072 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T00:40:50.078 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T00:40:50.125 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:40:50.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T00:40:50.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-04-26T00:40:50.184 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-04-26T00:40:50.259 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T00:40:50.268 INFO:teuthology.task.internal:Starting timer... 2024-04-26T00:40:50.268 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T00:40:50.286 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T00:40:50.300 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2024-04-26T00:40:50.300 DEBUG:teuthology.task.selinux:Excluding smithi188: OS 'ubuntu' does not support SELinux 2024-04-26T00:40:50.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T00:40:50.300 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T00:40:50.300 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T00:40:50.301 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T00:40:50.313 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T00:40:50.331 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T00:40:50.333 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T00:47:53.463 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-04-26T00:47:53.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:47:53.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:47:53.558 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-26T00:47:53.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-26T00:47:53.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:47:53.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T00:47:53.721 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-26T00:47:53.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-26T00:47:53.802 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T00:47:53.813 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T00:47:53.814 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T00:47:53.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:47:53.817 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T00:47:53.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Command line: ntpd -gq 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: ---------------------------------------------------- 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: corporation. Support and training for ntp-4 are 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: available at https://www.nwtime.org/support 2024-04-26T00:47:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: ---------------------------------------------------- 2024-04-26T00:47:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: proto: precision = 0.046 usec (-24) 2024-04-26T00:47:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: basedate set to 2022-02-04 2024-04-26T00:47:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: gps base set to 2022-02-06 (week 2196) 2024-04-26T00:47:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T00:47:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T00:47:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen normally on 3 ens1f0 172.21.15.6:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen normally on 4 lo [::1]:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%4]:123 2024-04-26T00:47:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:47:53 ntpd[17129]: Listening on routing socket on fd #22 for interface updates 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Command line: ntpd -gq 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: ---------------------------------------------------- 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: corporation. Support and training for ntp-4 are 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: available at https://www.nwtime.org/support 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: ---------------------------------------------------- 2024-04-26T00:47:53.870 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: proto: precision = 0.058 usec (-24) 2024-04-26T00:47:53.871 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: basedate set to 2022-02-04 2024-04-26T00:47:53.871 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: gps base set to 2022-02-06 (week 2196) 2024-04-26T00:47:53.871 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T00:47:53.871 INFO:teuthology.orchestra.run.smithi188.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T00:47:53.872 INFO:teuthology.orchestra.run.smithi188.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T00:47:53.873 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T00:47:53.873 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T00:47:53.873 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T00:47:53.874 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T00:47:53.874 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen normally on 3 enp3s0f1 172.21.15.188:123 2024-04-26T00:47:53.874 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen normally on 4 lo [::1]:123 2024-04-26T00:47:53.874 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8039%5]:123 2024-04-26T00:47:53.874 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:47:53 ntpd[17259]: Listening on routing socket on fd #22 for interface updates 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:54 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:54.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:54 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:56 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:56.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:56.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:56.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:56.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:56 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:57.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:57 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:57.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:57.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:57.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:57 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:58 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:58.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:58.872 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:58 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:59.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:59.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:59.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:59.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:59.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:47:59 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:47:59.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:59.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:59.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:47:59.870 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:47:59.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:47:59.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:47:59 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:48:00.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.844 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stdout:26 Apr 00:48:00 ntpd[17129]: ntpd: time slew +0.000814 s 2024-04-26T00:48:00.845 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew +0.000814s 2024-04-26T00:48:00.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T00:48:00.846 INFO:teuthology.orchestra.run.smithi006.stderr:26 Apr 00:48:00 ntpd[17129]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T00:48:00.871 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stdout:26 Apr 00:48:00 ntpd[17259]: ntpd: time slew +0.000401 s 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stdout:ntpd: time slew +0.000401s 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T00:48:00.872 INFO:teuthology.orchestra.run.smithi188.stderr:26 Apr 00:48:00 ntpd[17259]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T00:48:00.907 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:48:00.907 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-04-26T00:48:00.907 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.907 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.908 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.908 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.925 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:48:00.926 INFO:teuthology.run_tasks:Running task install... 2024-04-26T00:48:00.935 DEBUG:teuthology.task.install:project ceph 2024-04-26T00:48:00.935 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-26T00:48:00.935 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-26T00:48:00.935 INFO:teuthology.task.install:Using flavor: default 2024-04-26T00:48:00.941 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T00:48:00.941 INFO:teuthology.task.install:extra packages: [] 2024-04-26T00:48:00.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2024-04-26T00:48:00.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-key list | grep Ceph 2024-04-26T00:48:01.007 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T00:48:01.022 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T00:48:01.038 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T00:48:01.038 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T00:48:01.038 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T00:48:01.039 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-26T00:48:01.051 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T00:48:01.051 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T00:48:01.052 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T00:48:01.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-26T00:48:01.193 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-26T00:48:01.193 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:48:01.273 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-26T00:48:01.273 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:48:01.419 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:48:01.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T00:48:01.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-26T00:48:01.472 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:48:01.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T00:48:01.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-04-26T00:48:01.609 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:48:01.622 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T00:48:01.643 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T00:48:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T00:48:01.677 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T00:48:01.680 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T00:48:01.699 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T00:48:01.793 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T00:48:01.803 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T00:48:01.847 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T00:48:01.850 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T00:48:01.880 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T00:48:01.901 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-26T00:48:01.928 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T00:48:02.042 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 28.9 kB in 0s (70.0 kB/s) 2024-04-26T00:48:02.147 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T00:48:02.171 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T00:48:02.192 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-26T00:48:02.223 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T00:48:02.314 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 28.9 kB in 1s (45.8 kB/s) 2024-04-26T00:48:03.039 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:48:03.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:48:03.108 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-26T00:48:03.285 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-26T00:48:03.285 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-26T00:48:03.314 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:48:03.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:48:03.394 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-04-26T00:48:03.458 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:48:03.458 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:48:03.459 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:48:03.459 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:48:03.459 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T00:48:03.461 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T00:48:03.461 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T00:48:03.462 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T00:48:03.463 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T00:48:03.464 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet zip 2024-04-26T00:48:03.465 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T00:48:03.466 INFO:teuthology.orchestra.run.smithi188.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T00:48:03.467 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-04-26T00:48:03.467 INFO:teuthology.orchestra.run.smithi188.stdout: btrfs-tools 2024-04-26T00:48:03.562 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-04-26T00:48:03.562 INFO:teuthology.orchestra.run.smithi188.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T00:48:03.563 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T00:48:03.563 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T00:48:03.563 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T00:48:03.563 INFO:teuthology.orchestra.run.smithi188.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T00:48:03.563 INFO:teuthology.orchestra.run.smithi188.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T00:48:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T00:48:03.566 INFO:teuthology.orchestra.run.smithi188.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T00:48:03.598 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-04-26T00:48:03.599 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-04-26T00:48:03.752 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T00:48:03.752 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 179 MB of archives. 2024-04-26T00:48:03.752 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T00:48:03.752 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T00:48:03.781 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-26T00:48:03.805 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T00:48:03.806 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T00:48:03.807 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-04-26T00:48:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T00:48:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T00:48:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T00:48:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T00:48:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T00:48:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T00:48:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet zip 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T00:48:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T00:48:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T00:48:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T00:48:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T00:48:03.811 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-04-26T00:48:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: btrfs-tools 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T00:48:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T00:48:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T00:48:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T00:48:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T00:48:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T00:48:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T00:48:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T00:48:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T00:48:03.986 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T00:48:03.986 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 179 MB of archives. 2024-04-26T00:48:03.986 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T00:48:03.986 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T00:48:04.062 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-26T00:48:04.093 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T00:48:04.096 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T00:48:04.117 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T00:48:04.148 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-26T00:48:04.181 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T00:48:04.186 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T00:48:04.192 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T00:48:04.193 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T00:48:04.205 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T00:48:04.210 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T00:48:04.210 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T00:48:04.211 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T00:48:04.220 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T00:48:04.222 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T00:48:04.224 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T00:48:04.226 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T00:48:04.232 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T00:48:04.235 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T00:48:04.237 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T00:48:04.253 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T00:48:04.254 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T00:48:04.254 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T00:48:04.256 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T00:48:04.256 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T00:48:04.256 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T00:48:04.256 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T00:48:04.274 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T00:48:04.274 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T00:48:04.275 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T00:48:04.275 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T00:48:04.294 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T00:48:04.296 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T00:48:04.296 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T00:48:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T00:48:04.299 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T00:48:04.299 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T00:48:04.300 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T00:48:04.315 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T00:48:04.319 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T00:48:04.319 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T00:48:04.336 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T00:48:04.336 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T00:48:04.337 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T00:48:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T00:48:04.340 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T00:48:04.344 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T00:48:04.345 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T00:48:04.347 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-26T00:48:04.350 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-26T00:48:04.356 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T00:48:04.358 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T00:48:04.361 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T00:48:04.377 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T00:48:04.378 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T00:48:04.382 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T00:48:04.406 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-26T00:48:04.416 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-26T00:48:04.417 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-26T00:48:04.427 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-26T00:48:04.429 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-26T00:48:04.456 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T00:48:04.456 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T00:48:04.458 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T00:48:04.458 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T00:48:04.459 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T00:48:04.460 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-26T00:48:04.478 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T00:48:04.480 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T00:48:04.480 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T00:48:04.495 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T00:48:04.495 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T00:48:04.499 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T00:48:04.499 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T00:48:04.500 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T00:48:04.500 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T00:48:04.506 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T00:48:04.518 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T00:48:04.519 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T00:48:04.520 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T00:48:04.527 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T00:48:04.527 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T00:48:04.527 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T00:48:04.527 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T00:48:04.538 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-26T00:48:04.540 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T00:48:04.542 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T00:48:04.543 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T00:48:04.544 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T00:48:04.548 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T00:48:04.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T00:48:04.559 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T00:48:04.560 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T00:48:04.560 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T00:48:04.562 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T00:48:04.564 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T00:48:04.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T00:48:04.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T00:48:04.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T00:48:04.579 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T00:48:04.581 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T00:48:04.582 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T00:48:04.582 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-26T00:48:04.591 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T00:48:04.592 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T00:48:04.602 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T00:48:04.604 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T00:48:04.605 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T00:48:04.605 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-26T00:48:04.607 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-26T00:48:04.616 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-26T00:48:04.622 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-26T00:48:04.643 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-26T00:48:04.746 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T00:48:04.930 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-26T00:48:04.932 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-26T00:48:04.965 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-26T00:48:05.068 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-26T00:48:05.073 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-26T00:48:05.104 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-26T00:48:05.148 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T00:48:05.183 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T00:48:05.184 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T00:48:05.264 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T00:48:05.315 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T00:48:05.337 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T00:48:05.347 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T00:48:05.348 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T00:48:05.355 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T00:48:05.356 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T00:48:05.521 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T00:48:05.604 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T00:48:05.633 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T00:48:05.650 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T00:48:05.696 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T00:48:05.905 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T00:48:05.921 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T00:48:05.928 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T00:48:05.933 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T00:48:05.955 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T00:48:05.958 INFO:teuthology.orchestra.run.smithi188.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T00:48:06.124 INFO:teuthology.orchestra.run.smithi188.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T00:48:06.455 INFO:teuthology.orchestra.run.smithi188.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T00:48:06.494 INFO:teuthology.orchestra.run.smithi188.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T00:48:06.507 INFO:teuthology.orchestra.run.smithi188.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T00:48:06.712 INFO:teuthology.orchestra.run.smithi188.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T00:48:06.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-26T00:48:06.760 INFO:teuthology.orchestra.run.smithi188.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T00:48:06.761 INFO:teuthology.orchestra.run.smithi188.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T00:48:06.761 INFO:teuthology.orchestra.run.smithi188.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T00:48:06.761 INFO:teuthology.orchestra.run.smithi188.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T00:48:06.761 INFO:teuthology.orchestra.run.smithi188.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T00:48:06.766 INFO:teuthology.orchestra.run.smithi188.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T00:48:06.870 INFO:teuthology.orchestra.run.smithi188.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-26T00:48:06.941 INFO:teuthology.orchestra.run.smithi188.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T00:48:06.954 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-26T00:48:06.965 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-26T00:48:06.972 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-26T00:48:07.066 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-26T00:48:07.163 INFO:teuthology.orchestra.run.smithi188.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-26T00:48:07.180 INFO:teuthology.orchestra.run.smithi188.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-26T00:48:07.190 INFO:teuthology.orchestra.run.smithi188.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-26T00:48:07.203 INFO:teuthology.orchestra.run.smithi188.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T00:48:07.296 INFO:teuthology.orchestra.run.smithi188.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-26T00:48:07.382 INFO:teuthology.orchestra.run.smithi188.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T00:48:07.396 INFO:teuthology.orchestra.run.smithi188.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T00:48:07.415 INFO:teuthology.orchestra.run.smithi188.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T00:48:07.451 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-26T00:48:07.480 INFO:teuthology.orchestra.run.smithi188.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T00:48:07.736 INFO:teuthology.orchestra.run.smithi188.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-26T00:48:07.767 INFO:teuthology.orchestra.run.smithi188.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T00:48:07.769 INFO:teuthology.orchestra.run.smithi188.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T00:48:07.772 INFO:teuthology.orchestra.run.smithi188.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T00:48:07.772 INFO:teuthology.orchestra.run.smithi188.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T00:48:07.774 INFO:teuthology.orchestra.run.smithi188.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T00:48:08.000 INFO:teuthology.orchestra.run.smithi188.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T00:48:08.438 INFO:teuthology.orchestra.run.smithi188.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T00:48:08.608 INFO:teuthology.orchestra.run.smithi188.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T00:48:08.974 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-26T00:48:08.975 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-26T00:48:08.992 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-26T00:48:09.122 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-26T00:48:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-26T00:48:09.192 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-26T00:48:09.299 INFO:teuthology.orchestra.run.smithi188.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T00:48:09.319 INFO:teuthology.orchestra.run.smithi188.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-26T00:48:09.320 INFO:teuthology.orchestra.run.smithi188.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-26T00:48:09.336 INFO:teuthology.orchestra.run.smithi188.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-26T00:48:09.359 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-26T00:48:09.383 INFO:teuthology.orchestra.run.smithi188.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T00:48:09.441 INFO:teuthology.orchestra.run.smithi188.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-26T00:48:09.467 INFO:teuthology.orchestra.run.smithi188.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T00:48:09.488 INFO:teuthology.orchestra.run.smithi188.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-26T00:48:09.496 INFO:teuthology.orchestra.run.smithi188.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-26T00:48:09.550 INFO:teuthology.orchestra.run.smithi188.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T00:48:09.633 INFO:teuthology.orchestra.run.smithi188.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T00:48:09.634 INFO:teuthology.orchestra.run.smithi188.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-26T00:48:09.716 INFO:teuthology.orchestra.run.smithi188.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T00:48:09.799 INFO:teuthology.orchestra.run.smithi188.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T00:48:09.883 INFO:teuthology.orchestra.run.smithi188.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T00:48:09.976 INFO:teuthology.orchestra.run.smithi188.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T00:48:10.005 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-26T00:48:10.005 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-26T00:48:10.063 INFO:teuthology.orchestra.run.smithi188.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T00:48:10.186 INFO:teuthology.orchestra.run.smithi188.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-26T00:48:10.187 INFO:teuthology.orchestra.run.smithi188.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-26T00:48:10.230 INFO:teuthology.orchestra.run.smithi188.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T00:48:10.497 INFO:teuthology.orchestra.run.smithi188.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T00:48:10.824 INFO:teuthology.orchestra.run.smithi188.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T00:48:10.946 INFO:teuthology.orchestra.run.smithi188.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T00:48:11.039 INFO:teuthology.orchestra.run.smithi188.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T00:48:11.126 INFO:teuthology.orchestra.run.smithi188.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T00:48:11.279 INFO:teuthology.orchestra.run.smithi188.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T00:48:11.365 INFO:teuthology.orchestra.run.smithi188.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T00:48:11.482 INFO:teuthology.orchestra.run.smithi188.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T00:48:11.564 INFO:teuthology.orchestra.run.smithi188.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T00:48:11.651 INFO:teuthology.orchestra.run.smithi188.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T00:48:11.817 INFO:teuthology.orchestra.run.smithi188.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T00:48:12.213 INFO:teuthology.orchestra.run.smithi188.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T00:48:12.322 INFO:teuthology.orchestra.run.smithi188.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T00:48:12.613 INFO:teuthology.orchestra.run.smithi188.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T00:48:12.696 INFO:teuthology.orchestra.run.smithi188.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T00:48:12.779 INFO:teuthology.orchestra.run.smithi188.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T00:48:12.875 INFO:teuthology.orchestra.run.smithi188.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T00:48:12.961 INFO:teuthology.orchestra.run.smithi188.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T00:48:13.575 INFO:teuthology.orchestra.run.smithi188.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-26T00:48:13.578 INFO:teuthology.orchestra.run.smithi188.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-26T00:48:13.579 INFO:teuthology.orchestra.run.smithi188.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-26T00:48:13.712 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-26T00:48:13.715 INFO:teuthology.orchestra.run.smithi006.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-26T00:48:13.716 INFO:teuthology.orchestra.run.smithi006.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-26T00:48:14.236 INFO:teuthology.orchestra.run.smithi188.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-26T00:48:14.291 INFO:teuthology.orchestra.run.smithi006.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-26T00:48:14.800 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 179 MB in 11s (16.8 MB/s) 2024-04-26T00:48:14.881 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 179 MB in 10s (17.3 MB/s) 2024-04-26T00:48:14.967 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T00:48:15.011 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T00:48:15.068 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T00:48:15.073 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T00:48:15.111 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T00:48:15.116 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T00:48:15.158 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T00:48:15.201 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T00:48:15.494 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T00:48:15.521 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T00:48:15.546 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T00:48:15.560 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T00:48:15.573 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T00:48:15.613 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T00:48:15.880 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T00:48:15.907 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T00:48:15.947 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T00:48:15.949 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T00:48:15.975 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T00:48:16.015 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T00:48:16.367 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T00:48:16.394 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:16.402 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T00:48:16.429 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:16.443 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:16.494 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:16.845 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T00:48:16.871 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:16.897 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T00:48:16.912 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:16.924 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:16.964 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:17.240 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T00:48:17.267 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:17.298 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:17.575 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T00:48:17.602 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T00:48:17.642 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:48:17.651 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T00:48:17.674 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T00:48:17.718 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T00:48:17.961 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T00:48:17.977 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T00:48:18.011 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T00:48:18.037 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librados2. 2024-04-26T00:48:18.064 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:18.104 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:18.356 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2. 2024-04-26T00:48:18.383 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:18.422 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:18.549 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librbd1. 2024-04-26T00:48:18.575 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:18.615 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:18.875 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1. 2024-04-26T00:48:18.902 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:18.942 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:19.018 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T00:48:19.044 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:19.085 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:19.362 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rados. 2024-04-26T00:48:19.386 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T00:48:19.388 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:19.413 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:19.429 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:19.461 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:19.697 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2024-04-26T00:48:19.724 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:19.740 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T00:48:19.763 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:19.766 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:19.807 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:20.043 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T00:48:20.058 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:20.083 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T00:48:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:20.110 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:20.149 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:20.379 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T00:48:20.402 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T00:48:20.404 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:20.418 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:20.460 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:20.612 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:20.788 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T00:48:20.815 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:20.854 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:21.158 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T00:48:21.185 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T00:48:21.216 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T00:48:21.241 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T00:48:21.267 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T00:48:21.307 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T00:48:21.527 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T00:48:21.554 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T00:48:21.594 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T00:48:21.618 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T00:48:21.645 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T00:48:21.685 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T00:48:21.880 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T00:48:21.906 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:21.946 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T00:48:21.947 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:21.961 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:22.012 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:22.324 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T00:48:22.341 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T00:48:22.351 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T00:48:22.368 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T00:48:22.390 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T00:48:22.407 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T00:48:22.668 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T00:48:22.683 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T00:48:22.726 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T00:48:22.793 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T00:48:22.810 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T00:48:22.843 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T00:48:23.029 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T00:48:23.045 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T00:48:23.087 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T00:48:23.130 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T00:48:23.157 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T00:48:23.196 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T00:48:23.416 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua5.1. 2024-04-26T00:48:23.442 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T00:48:23.474 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T00:48:23.508 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua5.1. 2024-04-26T00:48:23.535 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T00:48:23.574 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T00:48:23.785 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-any. 2024-04-26T00:48:23.801 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T00:48:23.844 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T00:48:23.885 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-any. 2024-04-26T00:48:23.901 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T00:48:23.935 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T00:48:24.097 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package zip. 2024-04-26T00:48:24.112 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T00:48:24.138 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package zip. 2024-04-26T00:48:24.154 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T00:48:24.155 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T00:48:24.196 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T00:48:24.467 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package unzip. 2024-04-26T00:48:24.493 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T00:48:24.508 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package unzip. 2024-04-26T00:48:24.535 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T00:48:24.541 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T00:48:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T00:48:24.879 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package luarocks. 2024-04-26T00:48:24.905 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T00:48:24.945 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T00:48:24.961 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package luarocks. 2024-04-26T00:48:24.988 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T00:48:25.028 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T00:48:25.328 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librgw2. 2024-04-26T00:48:25.355 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:25.395 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:25.402 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2024-04-26T00:48:25.429 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:25.468 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:25.964 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T00:48:25.979 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:26.022 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:26.030 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T00:48:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:26.096 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T00:48:26.475 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T00:48:26.484 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T00:48:26.490 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T00:48:26.524 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T00:48:26.525 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T00:48:26.801 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T00:48:26.820 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T00:48:26.829 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:26.846 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:26.868 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:26.886 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:27.305 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2024-04-26T00:48:27.315 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-common. 2024-04-26T00:48:27.332 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:27.341 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:27.371 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:27.373 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:28.751 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2024-04-26T00:48:28.770 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-base. 2024-04-26T00:48:28.779 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:28.796 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:28.827 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:28.846 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:29.389 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T00:48:29.416 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T00:48:29.433 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T00:48:29.455 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T00:48:29.459 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T00:48:29.499 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T00:48:29.758 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T00:48:29.785 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T00:48:29.825 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T00:48:29.827 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T00:48:29.853 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T00:48:29.894 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T00:48:30.128 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T00:48:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T00:48:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T00:48:30.196 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T00:48:30.223 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T00:48:30.263 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T00:48:30.497 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T00:48:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T00:48:30.557 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T00:48:30.558 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T00:48:30.584 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T00:48:30.616 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T00:48:30.833 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T00:48:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T00:48:30.900 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T00:48:30.902 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T00:48:30.929 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T00:48:30.969 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T00:48:31.203 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T00:48:31.230 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T00:48:31.269 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T00:48:31.271 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T00:48:31.298 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T00:48:31.338 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T00:48:31.581 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-portend. 2024-04-26T00:48:31.608 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T00:48:31.624 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-portend. 2024-04-26T00:48:31.647 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T00:48:31.650 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T00:48:31.692 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T00:48:31.908 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T00:48:31.935 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T00:48:31.952 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T00:48:31.966 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T00:48:31.978 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T00:48:32.019 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T00:48:32.244 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T00:48:32.271 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T00:48:32.311 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T00:48:32.374 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T00:48:32.374 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T00:48:32.388 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T00:48:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T00:48:32.675 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T00:48:32.706 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T00:48:32.742 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T00:48:32.768 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T00:48:32.808 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T00:48:33.087 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T00:48:33.113 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T00:48:33.145 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T00:48:33.193 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T00:48:33.220 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T00:48:33.259 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T00:48:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T00:48:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T00:48:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T00:48:33.545 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T00:48:33.572 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T00:48:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T00:48:33.834 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-mako. 2024-04-26T00:48:33.861 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T00:48:33.901 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T00:48:33.914 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2024-04-26T00:48:33.942 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T00:48:33.981 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T00:48:34.229 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T00:48:34.255 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T00:48:34.292 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T00:48:34.312 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T00:48:34.319 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T00:48:34.359 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T00:48:34.573 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T00:48:34.589 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T00:48:34.632 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T00:48:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T00:48:34.681 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T00:48:34.711 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T00:48:34.934 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webob. 2024-04-26T00:48:34.961 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T00:48:34.998 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2024-04-26T00:48:35.001 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T00:48:35.025 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T00:48:35.064 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T00:48:35.337 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T00:48:35.364 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T00:48:35.407 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T00:48:35.417 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T00:48:35.444 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T00:48:35.487 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T00:48:35.701 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T00:48:35.727 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T00:48:35.767 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T00:48:35.795 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T00:48:35.822 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T00:48:35.861 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T00:48:36.028 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-paste. 2024-04-26T00:48:36.055 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T00:48:36.095 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T00:48:36.173 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2024-04-26T00:48:36.200 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T00:48:36.239 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T00:48:36.373 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T00:48:36.388 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T00:48:36.431 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T00:48:36.559 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T00:48:36.575 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T00:48:36.617 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T00:48:36.734 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T00:48:36.761 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T00:48:36.967 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T00:48:37.588 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T00:48:37.615 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T00:48:37.695 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T00:48:38.007 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T00:48:38.012 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T00:48:38.034 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T00:48:38.039 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T00:48:38.073 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T00:48:38.079 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T00:48:38.357 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T00:48:38.376 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T00:48:38.383 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T00:48:38.404 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T00:48:38.415 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T00:48:38.443 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T00:48:38.712 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T00:48:38.738 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T00:48:38.778 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T00:48:38.856 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T00:48:38.883 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T00:48:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T00:48:39.098 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-idna. 2024-04-26T00:48:39.124 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T00:48:39.164 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T00:48:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-idna. 2024-04-26T00:48:39.277 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T00:48:39.317 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T00:48:39.476 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T00:48:39.502 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T00:48:39.542 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T00:48:39.578 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T00:48:39.605 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T00:48:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T00:48:39.871 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests. 2024-04-26T00:48:39.897 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T00:48:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests. 2024-04-26T00:48:39.937 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T00:48:39.958 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T00:48:39.998 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T00:48:40.248 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T00:48:40.275 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T00:48:40.284 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T00:48:40.311 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T00:48:40.315 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T00:48:40.350 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T00:48:40.601 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T00:48:40.617 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:40.620 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T00:48:40.647 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:40.660 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:40.678 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:41.040 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T00:48:41.067 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:41.083 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T00:48:41.106 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:41.110 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:41.149 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:41.419 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T00:48:41.434 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T00:48:41.446 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T00:48:41.461 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T00:48:41.477 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T00:48:41.501 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T00:48:41.746 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T00:48:41.774 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T00:48:41.813 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T00:48:41.995 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T00:48:42.022 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T00:48:42.062 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T00:48:42.141 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T00:48:42.169 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:42.208 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:42.348 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T00:48:42.374 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:42.415 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:42.602 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T00:48:42.630 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:42.669 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:42.818 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T00:48:42.845 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:42.884 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:43.214 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T00:48:43.241 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:43.422 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:43.488 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T00:48:43.515 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:43.554 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:44.486 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2024-04-26T00:48:44.500 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:44.525 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph. 2024-04-26T00:48:44.537 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:44.542 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:44.574 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:44.861 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T00:48:44.888 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:44.894 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T00:48:44.921 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:44.928 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:44.960 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:45.306 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T00:48:45.306 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T00:48:45.333 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:45.333 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:45.364 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:45.372 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:45.751 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2024-04-26T00:48:45.778 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:45.792 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package cephadm. 2024-04-26T00:48:45.817 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:45.818 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:45.858 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:46.137 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T00:48:46.164 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T00:48:46.169 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T00:48:46.196 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T00:48:46.203 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T00:48:46.236 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T00:48:46.506 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T00:48:46.533 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T00:48:46.538 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T00:48:46.554 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T00:48:46.572 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T00:48:46.597 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T00:48:47.577 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-babel. 2024-04-26T00:48:47.593 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T00:48:47.627 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T00:48:47.677 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-babel. 2024-04-26T00:48:47.705 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T00:48:47.743 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T00:48:47.938 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T00:48:47.965 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T00:48:48.005 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T00:48:48.088 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T00:48:48.115 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T00:48:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T00:48:48.341 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T00:48:48.368 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:48.408 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:48.516 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T00:48:48.543 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:48.583 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:48.745 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T00:48:48.771 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T00:48:48.811 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T00:48:48.911 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T00:48:48.938 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T00:48:48.977 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T00:48:49.139 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-routes. 2024-04-26T00:48:49.166 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T00:48:49.205 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T00:48:49.280 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2024-04-26T00:48:49.307 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T00:48:49.346 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T00:48:49.542 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T00:48:49.569 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:49.708 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T00:48:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:49.775 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T00:48:50.888 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T00:48:50.922 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T00:48:50.980 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T00:48:51.007 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T00:48:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T00:48:51.359 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T00:48:51.386 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T00:48:51.425 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T00:48:51.558 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T00:48:51.586 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T00:48:51.625 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T00:48:51.787 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T00:48:51.814 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T00:48:51.854 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T00:48:51.928 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T00:48:51.956 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T00:48:51.994 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T00:48:52.281 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T00:48:52.308 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T00:48:52.313 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T00:48:52.340 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T00:48:52.347 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T00:48:52.381 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T00:48:53.041 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T00:48:53.069 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:53.073 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T00:48:53.102 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:53.176 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:53.226 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:54.163 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T00:48:54.190 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T00:48:54.229 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T00:48:54.288 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T00:48:54.316 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T00:48:54.354 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T00:48:54.499 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T00:48:54.517 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T00:48:54.557 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T00:48:54.641 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T00:48:54.668 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T00:48:54.707 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T00:48:54.861 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T00:48:54.888 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T00:48:54.927 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T00:48:55.061 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T00:48:55.088 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T00:48:55.127 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T00:48:55.230 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T00:48:55.257 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T00:48:55.296 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T00:48:55.438 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T00:48:55.466 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T00:48:55.505 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T00:48:55.609 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T00:48:55.636 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T00:48:55.675 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T00:48:55.800 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T00:48:55.828 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T00:48:55.866 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T00:48:55.962 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T00:48:55.989 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T00:48:56.028 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T00:48:56.179 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T00:48:56.206 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T00:48:56.244 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T00:48:56.323 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T00:48:56.350 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T00:48:56.389 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T00:48:56.514 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T00:48:56.530 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T00:48:56.572 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T00:48:56.726 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T00:48:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T00:48:56.793 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T00:48:56.893 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T00:48:56.920 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T00:48:56.959 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T00:48:57.432 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T00:48:57.448 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:57.490 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:57.573 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T00:48:57.590 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:48:57.622 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T00:48:57.828 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T00:48:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T00:48:57.909 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T00:48:57.937 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T00:48:57.975 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T00:48:58.187 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T00:48:58.215 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T00:48:58.254 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T00:48:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T00:48:58.340 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T00:48:58.436 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T00:48:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package jq. 2024-04-26T00:48:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T00:48:58.573 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T00:48:58.697 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2024-04-26T00:48:58.725 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T00:48:58.764 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T00:48:58.809 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package socat. 2024-04-26T00:48:58.837 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T00:48:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T00:48:59.017 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2024-04-26T00:48:59.044 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T00:48:59.083 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T00:48:59.179 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T00:48:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T00:48:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T00:48:59.428 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T00:48:59.456 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T00:48:59.503 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T00:48:59.584 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-test. 2024-04-26T00:48:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:59.650 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:48:59.865 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2024-04-26T00:48:59.882 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:48:59.923 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:01.905 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T00:49:01.932 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:49:01.971 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:02.236 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T00:49:02.249 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T00:49:02.264 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-26T00:49:02.266 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:02.303 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:02.308 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:02.590 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T00:49:02.606 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:02.648 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:02.836 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T00:49:02.864 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T00:49:02.902 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T00:49:02.959 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T00:49:02.987 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T00:49:03.025 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T00:49:03.232 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T00:49:03.260 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T00:49:03.298 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T00:49:03.372 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T00:49:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T00:49:03.438 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T00:49:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T00:49:03.706 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T00:49:03.744 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T00:49:03.750 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T00:49:03.778 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T00:49:03.809 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T00:49:04.150 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package pkg-config. 2024-04-26T00:49:04.177 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T00:49:04.188 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pkg-config. 2024-04-26T00:49:04.216 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T00:49:04.241 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T00:49:04.255 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T00:49:04.494 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T00:49:04.522 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T00:49:04.541 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T00:49:04.560 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T00:49:04.569 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T00:49:04.608 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T00:49:04.989 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T00:49:05.016 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T00:49:05.036 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T00:49:05.055 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T00:49:05.064 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T00:49:05.102 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T00:49:05.316 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T00:49:05.344 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T00:49:05.347 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T00:49:05.371 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T00:49:05.378 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T00:49:05.405 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T00:49:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T00:49:05.670 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T00:49:05.683 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T00:49:05.697 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T00:49:05.716 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T00:49:05.736 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T00:49:06.028 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T00:49:06.047 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T00:49:06.056 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T00:49:06.075 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T00:49:06.094 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T00:49:06.114 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T00:49:06.442 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-py. 2024-04-26T00:49:06.469 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T00:49:06.472 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2024-04-26T00:49:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T00:49:06.508 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T00:49:06.547 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T00:49:06.812 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T00:49:06.839 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T00:49:06.867 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T00:49:06.878 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T00:49:06.895 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T00:49:06.933 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T00:49:07.333 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T00:49:07.360 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T00:49:07.379 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T00:49:07.399 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T00:49:07.408 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T00:49:07.446 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T00:49:07.710 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-toml. 2024-04-26T00:49:07.738 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T00:49:07.773 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-toml. 2024-04-26T00:49:07.776 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T00:49:07.802 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T00:49:07.840 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T00:49:08.079 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T00:49:08.108 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T00:49:08.142 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T00:49:08.146 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T00:49:08.171 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T00:49:08.209 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T00:49:08.475 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T00:49:08.503 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T00:49:08.533 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T00:49:08.554 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T00:49:08.583 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T00:49:08.621 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T00:49:08.890 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T00:49:08.907 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T00:49:08.927 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T00:49:08.948 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T00:49:08.955 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T00:49:08.994 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T00:49:09.748 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package radosgw. 2024-04-26T00:49:09.775 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:09.814 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:09.911 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2024-04-26T00:49:09.940 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:09.977 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:10.634 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T00:49:10.650 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:10.692 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:10.763 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T00:49:10.791 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-26T00:49:10.830 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:10.970 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T00:49:11.134 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T00:49:11.230 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T00:49:11.356 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T00:49:11.411 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T00:49:11.511 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T00:49:11.619 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T00:49:11.777 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T00:49:11.936 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T00:49:12.137 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T00:49:12.334 INFO:teuthology.orchestra.run.smithi188.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T00:49:12.543 INFO:teuthology.orchestra.run.smithi006.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T00:49:12.629 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:12.709 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:13.192 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user cephadm....done 2024-04-26T00:49:13.221 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2024-04-26T00:49:13.332 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T00:49:13.378 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T00:49:13.592 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T00:49:13.830 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T00:49:13.852 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T00:49:13.978 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T00:49:14.123 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T00:49:14.229 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T00:49:14.249 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T00:49:14.488 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T00:49:14.500 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T00:49:14.615 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T00:49:14.759 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T00:49:14.886 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T00:49:14.908 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T00:49:15.187 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T00:49:15.252 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T00:49:15.511 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T00:49:15.556 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T00:49:15.779 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T00:49:15.815 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T00:49:16.055 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T00:49:16.083 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T00:49:16.293 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T00:49:16.307 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T00:49:16.552 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T00:49:16.558 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T00:49:16.812 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T00:49:16.850 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:17.110 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T00:49:17.146 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:17.236 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T00:49:17.362 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T00:49:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T00:49:17.488 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T00:49:17.506 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T00:49:17.616 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T00:49:17.742 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T00:49:17.755 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T00:49:17.993 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T00:49:18.238 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T00:49:18.272 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T00:49:18.327 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T00:49:18.380 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T00:49:18.407 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T00:49:18.453 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T00:49:18.471 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T00:49:18.597 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T00:49:18.821 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T00:49:18.947 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T00:49:18.973 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T00:49:19.082 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T00:49:19.206 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T00:49:19.351 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T00:49:19.457 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T00:49:19.635 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T00:49:19.750 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T00:49:19.876 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T00:49:19.961 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T00:49:20.087 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T00:49:20.578 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T00:49:20.764 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T00:49:20.846 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T00:49:20.972 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T00:49:21.015 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T00:49:21.098 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T00:49:21.124 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T00:49:21.250 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T00:49:21.382 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T00:49:21.542 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T00:49:21.750 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T00:49:21.936 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T00:49:22.001 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T00:49:22.187 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T00:49:22.369 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T00:49:22.563 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T00:49:22.670 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T00:49:22.848 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T00:49:23.013 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T00:49:23.191 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T00:49:23.248 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T00:49:23.357 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:23.442 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T00:49:23.551 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:23.675 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T00:49:23.853 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T00:49:23.976 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T00:49:24.229 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T00:49:25.081 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T00:49:25.342 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:25.467 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T00:49:25.476 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T00:49:25.727 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T00:49:25.745 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:25.853 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T00:49:25.887 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T00:49:25.979 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T00:49:26.163 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T00:49:26.280 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T00:49:26.289 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T00:49:26.415 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T00:49:26.531 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T00:49:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T00:49:26.765 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:26.892 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T00:49:26.976 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T00:49:27.201 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T00:49:27.227 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:27.353 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T00:49:27.524 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T00:49:27.654 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T00:49:27.778 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T00:49:27.889 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T00:49:28.038 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T00:49:28.148 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T00:49:28.297 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T00:49:28.407 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T00:49:28.565 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T00:49:28.667 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T00:49:28.691 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T00:49:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T00:49:28.959 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T00:49:29.070 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T00:49:29.085 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T00:49:29.354 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T00:49:29.402 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T00:49:29.480 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T00:49:29.703 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T00:49:29.764 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T00:49:29.966 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T00:49:30.057 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T00:49:30.080 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T00:49:30.190 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T00:49:30.279 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T00:49:30.308 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T00:49:30.434 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T00:49:30.516 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T00:49:30.560 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T00:49:30.642 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T00:49:30.667 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T00:49:30.912 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T00:49:31.038 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T00:49:31.043 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T00:49:31.336 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T00:49:31.423 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T00:49:31.462 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T00:49:31.682 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T00:49:31.713 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:31.809 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T00:49:31.839 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T00:49:32.117 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T00:49:32.174 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T00:49:32.244 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T00:49:32.492 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T00:49:32.570 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T00:49:32.759 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T00:49:32.871 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T00:49:32.885 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T00:49:33.153 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T00:49:33.155 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T00:49:33.256 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T00:49:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T00:49:33.691 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T00:49:33.792 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T00:49:34.107 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T00:49:34.162 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T00:49:34.467 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T00:49:34.564 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T00:49:34.752 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T00:49:34.832 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T00:49:35.096 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T00:49:35.197 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.209 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T00:49:35.323 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.335 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.449 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T00:49:35.470 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T00:49:35.785 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.899 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:35.911 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.037 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T00:49:36.050 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.176 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T00:49:36.313 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.440 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.461 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.566 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.587 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.705 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:36.777 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T00:49:36.778 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T00:49:36.916 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T00:49:36.916 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T00:49:37.259 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.411 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.422 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.535 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.550 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.661 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T00:49:37.674 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:37.800 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T00:49:38.891 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.008 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.088 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.135 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.191 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.260 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.306 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.386 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.433 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.559 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:39.928 INFO:teuthology.orchestra.run.smithi188.stdout:Adding group ceph....done 2024-04-26T00:49:40.061 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2024-04-26T00:49:40.238 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user ceph....done 2024-04-26T00:49:40.390 INFO:teuthology.orchestra.run.smithi188.stdout:Setting system user ceph properties....done 2024-04-26T00:49:40.405 INFO:teuthology.orchestra.run.smithi188.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T00:49:40.540 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T00:49:40.655 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2024-04-26T00:49:40.798 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2024-04-26T00:49:40.812 INFO:teuthology.orchestra.run.smithi006.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T00:49:40.860 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T00:49:40.967 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T00:49:41.330 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T00:49:41.336 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:41.462 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:41.795 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:41.905 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:41.922 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T00:49:41.922 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T00:49:42.362 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T00:49:42.362 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T00:49:42.422 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:42.741 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T00:49:42.773 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:43.114 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T00:49:43.199 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:43.423 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T00:49:43.423 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T00:49:43.600 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:43.833 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T00:49:43.833 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T00:49:43.926 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:44.145 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T00:49:44.145 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T00:49:44.285 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:44.515 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T00:49:44.515 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T00:49:44.618 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:44.901 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T00:49:44.901 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T00:49:44.986 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.276 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T00:49:45.276 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T00:49:45.395 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.504 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.655 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.739 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.864 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:45.872 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T00:49:45.873 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T00:49:45.999 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.204 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T00:49:46.204 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T00:49:46.340 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.491 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.617 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.708 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.768 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.834 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:46.961 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:47.104 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T00:49:47.111 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-26T00:49:47.221 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T00:49:47.374 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T00:49:47.565 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T00:49:47.715 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T00:49:47.859 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T00:49:48.500 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T00:49:48.935 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T00:49:49.198 INFO:teuthology.orchestra.run.smithi188.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T00:49:49.204 DEBUG:teuthology.parallel:result is None 2024-04-26T00:49:49.605 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T00:49:49.610 DEBUG:teuthology.parallel:result is None 2024-04-26T00:49:49.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-26T00:49:49.834 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2024-04-26T00:49:49.853 INFO:teuthology.orchestra.run.smithi006.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:49:49.854 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:49:49.854 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-26T00:49:49.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-26T00:49:50.000 DEBUG:teuthology.orchestra.run.smithi188:> dpkg-query -W -f '${Version}' ceph 2024-04-26T00:49:50.019 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:49:50.019 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-26T00:49:50.019 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-26T00:49:50.021 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T00:49:50.021 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:50.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T00:49:50.036 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:50.036 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T00:49:50.079 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T00:49:50.079 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:50.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T00:49:50.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T00:49:50.146 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:50.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T00:49:50.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T00:49:50.217 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T00:49:50.217 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:50.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T00:49:50.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T00:49:50.287 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:50.287 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T00:49:50.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T00:49:50.353 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T00:49:50.353 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:50.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T00:49:50.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T00:49:50.423 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:50.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T00:49:50.436 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T00:49:50.491 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T00:49:50.585 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T00:49:50.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-04-26T00:49:50.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-04-26T00:49:50.601 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T00:49:50.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T00:49:50.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T00:49:50.657 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T00:49:50.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T00:49:50.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T00:49:50.718 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T00:49:50.718 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T00:49:50.719 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T00:49:50.719 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:50.719 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T00:49:50.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T00:49:50.835 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:50.835 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T00:49:50.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T00:49:50.918 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T00:49:50.918 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T00:49:50.918 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945', 'branch': 'squid', 'description': 'rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7673945', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'], ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1']], 'seed': 9886, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '30270/100000', 'suite': 'rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFrdAeTv9oVh8Z2IaQmxxOQEA/3rXIk+NQIHiPIiKWJ09SejkJs8SywxNvVkqweOIAKkXAQ608e8w12rC5XWHog=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrWsmlqwLkORRO6ttno8atrloJWpgz4TJB/Rvd02tUR2SvHKwfddxbJ4SyUZe8LcUObYMbZQ1cdBHTZvhuNkEM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['mgr/test_localpool.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:00:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T00:49:50.919 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T00:49:50.921 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T00:49:50.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T00:49:50.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T00:49:51.019 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:51.019 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T00:49:51.027 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T00:49:51.027 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-04-26T00:49:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T00:49:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-04-26 00:44:37.180436332 +0000 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-04-26 00:44:36.932438547 +0000 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-04-26 00:44:36.932438547 +0000 2024-04-26T00:49:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-04-26T00:49:51.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T00:49:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-04-26T00:49:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-04-26T00:49:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000381423 s, 1.3 MB/s 2024-04-26T00:49:51.131 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T00:49:51.180 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-04-26 00:44:37.704431652 +0000 2024-04-26T00:49:51.227 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-04-26 00:44:37.428434117 +0000 2024-04-26T00:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-04-26 00:44:37.428434117 +0000 2024-04-26T00:49:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-04-26T00:49:51.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T00:49:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-04-26T00:49:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-04-26T00:49:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000306965 s, 1.7 MB/s 2024-04-26T00:49:51.288 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T00:49:51.337 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-04-26 00:44:38.240426865 +0000 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-04-26 00:44:37.944429509 +0000 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-04-26 00:44:37.944429509 +0000 2024-04-26T00:49:51.383 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-04-26T00:49:51.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T00:49:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-04-26T00:49:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-04-26T00:49:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000341243 s, 1.5 MB/s 2024-04-26T00:49:51.438 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T00:49:51.488 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-04-26T00:49:51.535 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-04-26 00:44:38.488424650 +0000 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-04-26 00:44:38.484424686 +0000 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-04-26 00:44:38.484424686 +0000 2024-04-26T00:49:51.536 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-04-26T00:49:51.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T00:49:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-04-26T00:49:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-04-26T00:49:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000284562 s, 1.8 MB/s 2024-04-26T00:49:51.591 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T00:49:51.640 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T00:49:51.640 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:51.640 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T00:49:51.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T00:49:51.646 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-26 00:44:33.918321683 +0000 2024-04-26T00:49:51.695 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-26 00:44:33.670323898 +0000 2024-04-26T00:49:51.696 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-26 00:44:33.670323898 +0000 2024-04-26T00:49:51.696 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-26T00:49:51.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T00:49:51.749 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-26T00:49:51.749 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-26T00:49:51.749 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.00045052 s, 1.1 MB/s 2024-04-26T00:49:51.750 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T00:49:51.800 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-04-26T00:49:51.846 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-26 00:44:34.422317182 +0000 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-26 00:44:34.158319539 +0000 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-26 00:44:34.158319539 +0000 2024-04-26T00:49:51.847 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-26T00:49:51.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T00:49:51.901 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-26T00:49:51.901 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-26T00:49:51.901 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.00041483 s, 1.2 MB/s 2024-04-26T00:49:51.902 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T00:49:51.952 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-26 00:44:34.870313180 +0000 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-26 00:44:34.646315181 +0000 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-26 00:44:34.646315181 +0000 2024-04-26T00:49:51.999 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-26T00:49:52.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T00:49:52.053 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-26T00:49:52.053 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-26T00:49:52.053 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000373284 s, 1.4 MB/s 2024-04-26T00:49:52.054 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T00:49:52.104 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-04-26T00:49:52.150 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-26 00:44:35.390308535 +0000 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-26 00:44:35.118310965 +0000 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-26 00:44:35.118310965 +0000 2024-04-26T00:49:52.151 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-26T00:49:52.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T00:49:52.205 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-26T00:49:52.205 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-26T00:49:52.205 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000353918 s, 1.4 MB/s 2024-04-26T00:49:52.207 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T00:49:52.256 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T00:49:52.256 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T00:49:52.256 INFO:tasks.ceph:Generating config... 2024-04-26T00:49:52.258 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[client] debug mgrc = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T00:49:52.258 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mds] debug mgrc = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mgr] mgr ttl cache expire seconds = 5 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T00:49:52.258 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T00:49:52.259 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug mgrc = 20 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T00:49:52.259 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T00:49:52.260 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T00:49:52.260 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T00:49:52.260 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T00:49:52.260 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T00:49:52.260 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T00:49:52.260 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T00:49:52.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T00:49:52.296 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T00:49:52.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T00:49:52.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T00:49:52.443 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.c', '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]'), ('mon.b', '172.21.15.188')] 2024-04-26T00:49:52.443 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.188', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mgrc': 20}} 2024-04-26T00:49:52.444 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:52.444 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T00:49:52.491 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --addv c '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]' --add b 172.21.15.188 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:52.579 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:52.579 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 67c57dbc-0204-4fdf-9da5-917e1a66c836 2024-04-26T00:49:52.579 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-04-26T00:49:52.579 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 67c57dbc-0204-4fdf-9da5-917e1a66c836 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-04-26T00:49:52.576097+0000 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-04-26T00:49:52.576097+0000 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 17 (quincy) 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 3 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.b 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] mon.c 2024-04-26T00:49:52.580 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T00:49:52.581 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T00:49:52.586 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 67c57dbc-0204-4fdf-9da5-917e1a66c836... 2024-04-26T00:49:52.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T00:49:52.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T00:49:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.188" 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: mon election default strategy = 3 2024-04-26T00:49:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 67c57dbc-0204-4fdf-9da5-917e1a66c836 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-04-26T00:49:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-04-26T00:49:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = stupid 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 20 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 20 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgrc = 20 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-04-26T00:49:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 10 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-04-26T00:49:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mgr ttl cache expire seconds = 5 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-04-26T00:49:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-04-26T00:49:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgrc = 20 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-04-26T00:49:52.672 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-04-26T00:49:52.673 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-04-26T00:49:52.673 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2024-04-26T00:49:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgrc = 20 2024-04-26T00:49:52.674 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-04-26T00:49:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-04-26T00:49:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T00:49:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-04-26T00:49:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.188" 2024-04-26T00:49:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: mon election default strategy = 3 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 67c57dbc-0204-4fdf-9da5-917e1a66c836 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-04-26T00:49:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-04-26T00:49:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = stupid 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 20 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 20 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgrc = 20 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-04-26T00:49:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 10 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-04-26T00:49:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mgr ttl cache expire seconds = 5 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-04-26T00:49:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-04-26T00:49:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgrc = 20 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-04-26T00:49:52.684 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-04-26T00:49:52.685 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-04-26T00:49:52.685 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2024-04-26T00:49:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgrc = 20 2024-04-26T00:49:52.685 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T00:49:52.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T00:49:52.769 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T00:49:52.769 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:52.770 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T00:49:52.775 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:52.775 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T00:49:52.823 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-04-26T00:49:52.823 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:52.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T00:49:52.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T00:49:52.888 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:49:52.889 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:52.935 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:49:52.935 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:52.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T00:49:52.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T00:49:52.958 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:49:52.958 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:53.007 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T00:49:53.007 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T00:49:53.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T00:49:53.050 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T00:49:53.053 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T00:49:53.096 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T00:49:53.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-04-26T00:49:53.200 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-04-26T00:49:53.202 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T00:49:53.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T00:49:53.247 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T00:49:53.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T00:49:53.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T00:49:53.346 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T00:49:53.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T00:49:53.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T00:49:53.448 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T00:49:53.451 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T00:49:53.511 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T00:49:53.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T00:49:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T00:49:53.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T00:49:53.592 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T00:49:53.603 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T00:49:53.603 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T00:49:53.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T00:49:53.616 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T00:49:53.616 INFO:tasks.ceph:role: osd.0 2024-04-26T00:49:53.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-04-26T00:49:53.616 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T00:49:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T00:49:53.679 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T00:49:53.679 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T00:49:53.679 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T00:49:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T00:49:53.680 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-04-26T00:49:53.680 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T00:49:53.680 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T00:49:53.680 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T00:49:53.680 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T00:49:54.150 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-04-26T00:49:54.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-04-26T00:49:54.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T00:49:54.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T00:49:54.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:49:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T00:49:54.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:54.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.457+0000 7f017fbc27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T00:49:54.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.461+0000 7f017fbc27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T00:49:54.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.461+0000 7f017fbc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T00:49:54.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.461+0000 7f017fbc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T00:49:54.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.461+0000 7f017fbc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T00:49:54.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:49:54.465+0000 7f017fbc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T00:49:57.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T00:49:57.453 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T00:49:57.470 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T00:49:57.470 INFO:tasks.ceph:role: osd.1 2024-04-26T00:49:57.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:49:57.470 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T00:49:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T00:49:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-04-26T00:49:57.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-04-26T00:49:57.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T00:49:58.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T00:49:58.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:49:58.092 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T00:49:58.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T00:49:58.145 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T00:49:58.145 INFO:tasks.ceph:role: osd.2 2024-04-26T00:49:58.145 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:49:58.145 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T00:49:58.207 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T00:49:58.207 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T00:49:58.207 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T00:49:58.207 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T00:49:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T00:49:58.673 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-04-26T00:49:58.675 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-04-26T00:49:58.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-26T00:49:58.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T00:49:58.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:49:58.816 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T00:49:58.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T00:49:58.870 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T00:49:58.870 INFO:tasks.ceph:role: osd.3 2024-04-26T00:49:58.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:49:58.871 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T00:49:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T00:49:58.936 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T00:49:58.936 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T00:49:59.416 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-04-26T00:49:59.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-04-26T00:49:59.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-26T00:49:59.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T00:49:59.582 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T00:49:59.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:49:59.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:49:59.701 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.693+0000 7f872cc537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T00:49:59.702 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.697+0000 7f872cc537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T00:49:59.702 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.697+0000 7f872cc537c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T00:49:59.702 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.697+0000 7f872cc537c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T00:49:59.702 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.697+0000 7f872cc537c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T00:49:59.702 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:49:59.697+0000 7f872cc537c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T00:50:02.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T00:50:02.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:50:02.804 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T00:50:02.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T00:50:02.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T00:50:02.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T00:50:02.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T00:50:02.806 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:02.797+0000 7f2612ace7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T00:50:05.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T00:50:05.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:50:05.933 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.925+0000 7f65267a57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T00:50:05.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.929+0000 7f65267a57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T00:50:05.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.929+0000 7f65267a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T00:50:05.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.929+0000 7f65267a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T00:50:05.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.929+0000 7f65267a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T00:50:05.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:05.929+0000 7f65267a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T00:50:08.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T00:50:08.966 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T00:50:08.967 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:08.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T00:50:08.982 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:08.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T00:50:09.040 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:09.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T00:50:09.096 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:09.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T00:50:09.151 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T00:50:09.165 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-04-26T00:50:09.218 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T00:50:09.273 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T00:50:09.330 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T00:50:09.386 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.386 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T00:50:09.441 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:09.442 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T00:50:09.448 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:09.448 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T00:50:09.487 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T00:50:09.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T00:50:09.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmfWzQAhAAw2Bfzqzihx3TrwFlpUtYrg== 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmrR2RDhAAouj0oTgcjXaRp0YWSHokFA== 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmtKVzFBAAGFuW0Nfs6Za2C3zGBYrJ7w== 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAy+ipmIVSYGxAAgnFLHdkLLJqfNTWApGPMZg== 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-04-26T00:50:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmd/2cBRAABmYDEXsRyUaYAat4cWubig== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.z] 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmLNnKCxAAYEEldIMpgv0svCFIy+EkOA== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmKwqgGhAAgN56TxZgp9obNhjaVjONdg== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA3+ipmoEOxKRAAu2Iz1O5+c3XVSB0a6FrE5g== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA6+ipm0OjWLxAAxu8Jr1YAfgBzJx5mRFWlhw== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQA9+ipmJdiCNxAAaNiAV3u7HHckgdRSkJI2Iw== 2024-04-26T00:50:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-04-26T00:50:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmJoBxIBAAB1CsujXN3ETRzP2oDbVFwg== 2024-04-26T00:50:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2024-04-26T00:50:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAx+ipmMr0zIxAAJJOZ3Cy7YLsQauBiuHayZQ== 2024-04-26T00:50:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2024-04-26T00:50:09.540 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmfWzQAhAAw2Bfzqzihx3TrwFlpUtYrg== 2024-04-26T00:50:09.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-04-26T00:50:09.540 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmrR2RDhAAouj0oTgcjXaRp0YWSHokFA== 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmtKVzFBAAGFuW0Nfs6Za2C3zGBYrJ7w== 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAy+ipmIVSYGxAAgnFLHdkLLJqfNTWApGPMZg== 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.y] 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmd/2cBRAABmYDEXsRyUaYAat4cWubig== 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.z] 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmLNnKCxAAYEEldIMpgv0svCFIy+EkOA== 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-04-26T00:50:09.541 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmKwqgGhAAgN56TxZgp9obNhjaVjONdg== 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQA3+ipmoEOxKRAAu2Iz1O5+c3XVSB0a6FrE5g== 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQA6+ipm0OjWLxAAxu8Jr1YAfgBzJx5mRFWlhw== 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQA9+ipmJdiCNxAAaNiAV3u7HHckgdRSkJI2Iw== 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmJoBxIBAAB1CsujXN3ETRzP2oDbVFwg== 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2024-04-26T00:50:09.542 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAx+ipmMr0zIxAAJJOZ3Cy7YLsQauBiuHayZQ== 2024-04-26T00:50:09.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:09.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:09.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:09.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:09.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:09.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:09.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:09.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:09.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:09.854 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:09.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:09.940 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T00:50:10.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:10.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T00:50:10.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.121 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T00:50:10.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T00:50:10.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T00:50:10.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T00:50:10.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T00:50:10.549 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T00:50:10.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T00:50:10.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T00:50:10.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T00:50:10.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T00:50:10.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T00:50:10.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T00:50:10.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T00:50:10.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T00:50:10.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T00:50:10.968 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:50:10.970 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T00:50:11.014 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T00:50:11.014 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T00:50:11.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T00:50:11.020 INFO:tasks.ceph.mon.a:Started 2024-04-26T00:50:11.020 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T00:50:11.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T00:50:11.022 INFO:tasks.ceph.mon.c:Started 2024-04-26T00:50:11.022 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T00:50:11.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T00:50:11.060 INFO:tasks.ceph.mon.b:Started 2024-04-26T00:50:11.060 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T00:50:11.060 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T00:50:11.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T00:50:11.062 INFO:tasks.ceph.mgr.x:Started 2024-04-26T00:50:11.062 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T00:50:11.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T00:50:11.065 INFO:tasks.ceph.mgr.y:Started 2024-04-26T00:50:11.065 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-04-26T00:50:11.065 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-04-26T00:50:11.068 INFO:tasks.ceph.mgr.z:Started 2024-04-26T00:50:11.068 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T00:50:11.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T00:50:11.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 Processor -- start 2024-04-26T00:50:11.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 -- start start 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb8072a90 con 0x7fbdb80b9650 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb8135490 con 0x7fbdb80b9270 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdbd3bf640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb8072600 con 0x7fbdb80aca50 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb67fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdb80b9650 0x7fbdb8135ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38760/0 (socket says 172.21.15.6:38760) 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb67fc640 1 -- 172.21.15.6:0/2415824727 learned_addr learned my addr 172.21.15.6:0/2415824727 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:50:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:50:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T00:50:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:11.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T00:50:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:12.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T00:50:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 msgr2=0x7fbdb814d6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb80aca50 0x7fbdb814d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbdb80ac510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbdb80ac510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 >> v1:172.21.15.6:6789/0 conn(0x7fbdb80b9650 legacy=0x7fbdb8135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb81356c0 con 0x7fbda40061a0 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb8072600 con 0x7fbda40036f0 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:50:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:50:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.789+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.789+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:14.789+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T00:50:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:15.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:15.593+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:15.593+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:15.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:15.593+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 msgr2=0x7fbda4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda40036f0 0x7fbda4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 >> v1:172.21.15.188:6789/0 conn(0x7fbda40061a0 legacy=0x7fbda4008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 reap_dead start 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda400af90 con 0x7fbda400a550 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb8072600 con 0x7fbda400a9d0 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb4ff9640 1 -- 172.21.15.6:0/2415824727 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbda4008650 con 0x7fbdb80b9270 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbda400a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbda400a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 msgr2=0x7fbda4005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 msgr2=0x7fbda4005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:17.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.181+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:50:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 msgr2=0x7fbda4005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 msgr2=0x7fbda4005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbda400a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbda400a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:50:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.385+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:50:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931536640 0 0) 0x7fbda400af90 con 0x7fbda400a550 2024-04-26T00:50:17.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda0003530 con 0x7fbda400a550 2024-04-26T00:50:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2380992262 0 0) 0x7fbda0003530 con 0x7fbda400a550 2024-04-26T00:50:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 msgr2=0x7fbda400a010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.188:3300/0 conn(0x7fbdb80b9270 0x7fbda400a010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 msgr2=0x7fbda4005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/2415824727 >> v2:172.21.15.6:3300/0 conn(0x7fbda400a9d0 0x7fbda4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4008820 con 0x7fbda400a550 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7fbda80016c0 con 0x7fbda400a550 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 >> v1:172.21.15.6:6789/0 conn(0x7fbda400a550 legacy=0x7fbda4008e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0003a30 0x7fbda0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 0x7fbda0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda0005220 0x7fbda000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8072600 con 0x7fbda0003a30 2024-04-26T00:50:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4008650 con 0x7fbda0004810 2024-04-26T00:50:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fbda000c1d0 con 0x7fbda0005220 2024-04-26T00:50:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.397+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda0005220 0x7fbda000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 0x7fbda0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0003a30 0x7fbda0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda0005220 msgr2=0x7fbda000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda0005220 0x7fbda000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0003a30 msgr2=0x7fbda0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0003a30 0x7fbda0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb77fe640 1 -- 172.21.15.6:0/2415824727 reap_dead start 2024-04-26T00:50:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb67fc640 1 -- 172.21.15.6:0/2415824727 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4008820 con 0x7fbda0004810 2024-04-26T00:50:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.401+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0003a30 0x7fbda0003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdb67fc640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 0x7fbda0004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c260 tx=0x7fbda801cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7000921eaaf19372 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8007d20 con 0x7fbda0004810 2024-04-26T00:50:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda80a9070 con 0x7fbda0004810 2024-04-26T00:50:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/2415824727 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8005d20 con 0x7fbda0004810 2024-04-26T00:50:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 msgr2=0x7fbda0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 0x7fbda0004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c260 tx=0x7fbda801cba0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2415824727 shutdown_connections 2024-04-26T00:50:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2415824727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda0004810 0x7fbda0004c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2415824727 >> 172.21.15.6:0/2415824727 conn(0x7fbdb8070610 msgr2=0x7fbdb80b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2415824727 shutdown_connections 2024-04-26T00:50:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.409+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2415824727 wait complete. 2024-04-26T00:50:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 Processor -- start 2024-04-26T00:50:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 -- start start 2024-04-26T00:50:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 0x7fbdb81327a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb8132ce0 0x7fbdb81dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80a91f0 con 0x7fbda0004810 2024-04-26T00:50:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8072390 con 0x7fbdb81d1da0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80a9370 con 0x7fbdb8132ce0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58188/0 (socket says 172.21.15.6:58188) 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb67fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 0x7fbdb81327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2028829220 learned_addr learned my addr 172.21.15.6:0/2028829220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb77fe640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb8132ce0 0x7fbdb81dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb8132ce0 msgr2=0x7fbdb81dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb8132ce0 0x7fbdb81dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2028829220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 msgr2=0x7fbdb81327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 0x7fbdb81327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 -- 172.21.15.6:0/2028829220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8133520 con 0x7fbda0004810 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb67fc640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 0x7fbdb81327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdb6ffd640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdac006a80 tx=0x7fbdac016c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac02a070 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac004440 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb8133790 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.413+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac00f040 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb8131ec0 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb806db70 con 0x7fbda0004810 2024-04-26T00:50:17.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbdac02d070 con 0x7fbda0004810 2024-04-26T00:50:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:17.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.417+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbdac02f440 con 0x7fbda0004810 2024-04-26T00:50:17.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.421+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbdac022070 con 0x7fbda0004810 2024-04-26T00:50:17.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.485+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbdb809c9d0 con 0x7fbda0004810 2024-04-26T00:50:17.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbd9f7fe640 1 -- 172.21.15.6:0/2028829220 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbdac003620 con 0x7fbda0004810 2024-04-26T00:50:17.495 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 10 mgrc shutdown 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 msgr2=0x7fbdb809b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdac006a80 tx=0x7fbdac016c20 comp rx=0 tx=0).stop 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 shutdown_connections 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb8132ce0 0x7fbdb81dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb81d1da0 0x7fbdb81327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 --2- 172.21.15.6:0/2028829220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda0004810 0x7fbdb809b730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 >> 172.21.15.6:0/2028829220 conn(0x7fbdb8070610 msgr2=0x7fbdb8137c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:17.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 shutdown_connections 2024-04-26T00:50:17.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:17.489+0000 7fbdbd3bf640 1 -- 172.21.15.6:0/2028829220 wait complete. 2024-04-26T00:50:17.514 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T00:50:17.514 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T00:50:17.515 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:50:17.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T00:50:17.526 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:17.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T00:50:17.541 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:17.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T00:50:17.594 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-26T00:50:17.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T00:50:17.624 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:17.617+0000 7f388f13f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:50:17.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 0d96861c-0189-4a71-b899-1c1c734ac14a 0 2024-04-26T00:50:17.694 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:17.688+0000 7fe3cf4b5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:50:17.694 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:17.688+0000 7fd07b1ec180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:50:17.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 Processor -- start 2024-04-26T00:50:17.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 -- start start 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ce40b61e0 0x7f8ce4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8ce406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce41486e0 con 0x7f8ce40b5030 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce40b65c0 con 0x7f8ce40b61e0 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cebdaf640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce41493b0 con 0x7f8ce40b7340 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cea34c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f8ce40b5030 0x7f8ce4148ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:58638/0 (socket says 172.21.15.188:58638) 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8cea34c640 1 -- 172.21.15.188:0/572209651 learned_addr learned my addr 172.21.15.188:0/572209651 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce934a640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8ce406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.811 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/572209651 >> v2:172.21.15.6:3300/0 conn(0x7f8ce40b61e0 0x7f8ce4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187781515 0 0) 0x7f8ce41486e0 con 0x7f8ce40b5030 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cd0003530 con 0x7f8ce40b5030 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1182613791 0 0) 0x7f8cd0003530 con 0x7f8ce40b5030 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 msgr2=0x7f8ce406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8ce406ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 >> v2:172.21.15.6:3300/0 conn(0x7f8ce40b61e0 msgr2=0x7f8ce4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.800+0000 7f8ce8b49640 1 --2- 172.21.15.188:0/572209651 >> v2:172.21.15.6:3300/0 conn(0x7f8ce40b61e0 0x7f8ce4070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce40b3f70 con 0x7f8ce40b5030 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f8cdc001a20 con 0x7f8ce40b5030 2024-04-26T00:50:17.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 >> v1:172.21.15.188:6789/0 conn(0x7f8ce40b5030 legacy=0x7f8ce4148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cd0003a30 0x7f8cd0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd0004810 0x7f8cd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8cd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40b65c0 con 0x7f8cd0004810 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41493b0 con 0x7f8cd0003a30 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd000b9d0 con 0x7f8ce40b7340 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cd0003a30 0x7f8cd0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce934a640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd0004810 0x7f8cd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8cea34c640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8cd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 -- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 msgr2=0x7f8cd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8cd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 -- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd0004810 msgr2=0x7f8cd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd0004810 0x7f8cd0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 -- 172.21.15.188:0/572209651 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd0003530 con 0x7f8cd0003a30 2024-04-26T00:50:17.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce934a640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd0004810 0x7f8cd0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:17.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8cea34c640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40b7340 0x7f8cd00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cd0003a30 0x7f8cd0003e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009b10 tx=0x7f8ce001ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c3fc4d66c2a60c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b2070 con 0x7f8cd0003a30 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a55a0 con 0x7f8cd0003a30 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.804+0000 7f8ce8b49640 1 -- 172.21.15.188:0/572209651 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00096b0 con 0x7f8cd0003a30 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/572209651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cd0003a30 msgr2=0x7f8cd0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 --2- 172.21.15.188:0/572209651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cd0003a30 0x7f8cd0003e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009b10 tx=0x7f8ce001ca90 comp rx=0 tx=0).stop 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 -- 172.21.15.188:0/572209651 reap_dead start 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/572209651 shutdown_connections 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/572209651 >> 172.21.15.188:0/572209651 conn(0x7f8ce406cb40 msgr2=0x7f8ce406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:17.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/572209651 shutdown_connections 2024-04-26T00:50:17.816 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/572209651 wait complete. 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 Processor -- start 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- start start 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 0x7f8ce413b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40af830 0x7f8ce413b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:17.818 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce406bdc0 con 0x7f8ce40aaa40 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce406bc40 con 0x7f8ce4140740 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce414b8e0 con 0x7f8ce40af830 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43700/0 (socket says 172.21.15.188:43700) 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 -- 172.21.15.188:0/1994874677 learned_addr learned my addr 172.21.15.188:0/1994874677 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8ce934a640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40af830 0x7f8ce413b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 0x7f8ce413b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 -- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40af830 msgr2=0x7f8ce413b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40af830 0x7f8ce413b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 -- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 msgr2=0x7f8ce413b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 0x7f8ce413b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 -- 172.21.15.188:0/1994874677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce4071cf0 con 0x7f8ce4140740 2024-04-26T00:50:17.819 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8ce9b4b640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 0x7f8ce413b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cea34c640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ce406c390 tx=0x7f8cdc0119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc010040 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc01a070 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce41da1b0 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc013a00 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce413bf90 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cdc013ba0 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.808+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8cdc0154e0 con 0x7f8ce4140740 2024-04-26T00:50:17.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.812+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce406db70 con 0x7f8ce4140740 2024-04-26T00:50:17.821 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.812+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8ce4071cf0 con 0x7f8ce4140740 2024-04-26T00:50:17.889 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.880+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d96861c-0189-4a71-b899-1c1c734ac14a", "id": 0} v 0) -- 0x7f8ce40b4a00 con 0x7f8ce4140740 2024-04-26T00:50:17.898 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.888+0000 7f8cda7fc640 1 -- 172.21.15.188:0/1994874677 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d96861c-0189-4a71-b899-1c1c734ac14a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8cdc01f460 con 0x7f8ce4140740 2024-04-26T00:50:17.898 INFO:teuthology.orchestra.run.smithi188.stdout:0 2024-04-26T00:50:17.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 10 mgrc shutdown 2024-04-26T00:50:17.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 msgr2=0x7f8ce4140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:17.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ce406c390 tx=0x7f8cdc0119d0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 shutdown_connections 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ce4140740 0x7f8ce4140bc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ce40af830 0x7f8ce413b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 --2- 172.21.15.188:0/1994874677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce40aaa40 0x7f8ce413b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 >> 172.21.15.188:0/1994874677 conn(0x7f8ce406cb40 msgr2=0x7f8ce41472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 shutdown_connections 2024-04-26T00:50:17.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:17.892+0000 7f8cebdaf640 1 -- 172.21.15.188:0/1994874677 wait complete. 2024-04-26T00:50:17.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 135a11ee-8193-4d19-8131-ff670741a1d4 1 2024-04-26T00:50:18.074 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 Processor -- start 2024-04-26T00:50:18.075 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 -- start start 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1ca00b61e0 0x7f1ca0070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ca00b7340 0x7f1ca006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b5030 0x7f1ca0148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca01486e0 con 0x7f1ca00b7340 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca00b65c0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1ca4a2f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca00b3f70 con 0x7f1ca00b5030 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1ca00b61e0 0x7f1ca0070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1ca00b61e0 0x7f1ca0070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43708/0 (socket says 172.21.15.188:43708) 2024-04-26T00:50:18.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 -- 172.21.15.188:0/1457873855 learned_addr learned my addr 172.21.15.188:0/1457873855 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9dd9b640 1 --2- 172.21.15.188:0/1457873855 >> v2:172.21.15.6:3300/0 conn(0x7f1ca00b7340 0x7f1ca006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 -- 172.21.15.188:0/1457873855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b5030 msgr2=0x7f1ca0148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 --2- 172.21.15.188:0/1457873855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b5030 0x7f1ca0148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 -- 172.21.15.188:0/1457873855 >> v2:172.21.15.6:3300/0 conn(0x7f1ca00b7340 msgr2=0x7f1ca006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 --2- 172.21.15.188:0/1457873855 >> v2:172.21.15.6:3300/0 conn(0x7f1ca00b7340 0x7f1ca006ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.068+0000 7f1c9e59c640 1 -- 172.21.15.188:0/1457873855 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca01491e0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.078 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9e59c640 1 --2- 172.21.15.188:0/1457873855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0070320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00b4730 tx=0x7f1c9001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf9fd09f8c31677 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.078 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9d59a640 1 -- 172.21.15.188:0/1457873855 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900b0070 con 0x7f1ca00b61e0 2024-04-26T00:50:18.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9d59a640 1 -- 172.21.15.188:0/1457873855 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c900ab600 con 0x7f1ca00b61e0 2024-04-26T00:50:18.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9d59a640 1 -- 172.21.15.188:0/1457873855 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ab9d0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1457873855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 msgr2=0x7f1ca0070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1457873855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0070320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00b4730 tx=0x7f1c9001c500 comp rx=0 tx=0).stop 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1457873855 shutdown_connections 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1457873855 >> v2:172.21.15.6:3300/0 conn(0x7f1ca00b7340 0x7f1ca006ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1457873855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b5030 0x7f1ca0148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1457873855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0070320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1457873855 >> 172.21.15.188:0/1457873855 conn(0x7f1ca006cb40 msgr2=0x7f1ca006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.080 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1457873855 shutdown_connections 2024-04-26T00:50:18.081 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1457873855 wait complete. 2024-04-26T00:50:18.086 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 Processor -- start 2024-04-26T00:50:18.086 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- start start 2024-04-26T00:50:18.086 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca00b5030 0x7f1ca01413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b7340 0x7f1ca01453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca00a7ff0 con 0x7f1ca00b5030 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca00a7e70 con 0x7f1ca00b61e0 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1ca4a2f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca00a8170 con 0x7f1ca00b7340 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43722/0 (socket says 172.21.15.188:43722) 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 -- 172.21.15.188:0/1417713275 learned_addr learned my addr 172.21.15.188:0/1417713275 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9e59c640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca00b5030 0x7f1ca01413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9ed9d640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b7340 0x7f1ca01453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 -- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b7340 msgr2=0x7f1ca01453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b7340 0x7f1ca01453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 -- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca00b5030 msgr2=0x7f1ca01413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.087 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca00b5030 0x7f1ca01413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.072+0000 7f1c9dd9b640 1 -- 172.21.15.188:0/1417713275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca0147910 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c9dd9b640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c7f0 tx=0x7f1c9400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94015070 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c94007820 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca013abf0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94007c10 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01e0d50 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c94018070 con 0x7f1ca00b61e0 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:18.088 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1c940117a0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.089 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca006db70 con 0x7f1ca00b61e0 2024-04-26T00:50:18.089 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.076+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1ca013abf0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.155 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.148+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "135a11ee-8193-4d19-8131-ff670741a1d4", "id": 1} v 0) -- 0x7f1ca00a9a40 con 0x7f1ca00b61e0 2024-04-26T00:50:18.161 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.152+0000 7f1c8effd640 1 -- 172.21.15.188:0/1417713275 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "135a11ee-8193-4d19-8131-ff670741a1d4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1c94007db0 con 0x7f1ca00b61e0 2024-04-26T00:50:18.161 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.152+0000 7f1ca4a2f640 10 mgrc shutdown 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.152+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 msgr2=0x7f1ca0144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.152+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c7f0 tx=0x7f1c9400ccb0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 shutdown_connections 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ca00b7340 0x7f1ca01453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ca00b61e0 0x7f1ca0144eb0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c7f0 tx=0x7f1c9400ccb0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.162 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 --2- 172.21.15.188:0/1417713275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca00b5030 0x7f1ca01413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.163 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 >> 172.21.15.188:0/1417713275 conn(0x7f1ca006cb40 msgr2=0x7f1ca013e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.163 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 shutdown_connections 2024-04-26T00:50:18.163 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.156+0000 7f1ca4a2f640 1 -- 172.21.15.188:0/1417713275 wait complete. 2024-04-26T00:50:18.167 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:18.161+0000 7f388f13f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:50:18.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new da9ff617-5bf7-4c67-ab53-42edca7d24a7 2 2024-04-26T00:50:18.231 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:18.224+0000 7fd07b1ec180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:50:18.231 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:18.224+0000 7fe3cf4b5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:50:18.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 Processor -- start 2024-04-26T00:50:18.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 -- start start 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb9940b61e0 0x7fb994070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 0x7fb99406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9941486e0 con 0x7fb9940b5030 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb9940b65c0 con 0x7fb9940b61e0 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb999fde640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fb9941493b0 con 0x7fb9940b7340 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb992ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 0x7fb99406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb9937fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb9940b61e0 0x7fb994070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb993fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9940b5030 0x7fb994148ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.188:50530/0 (socket says 172.21.15.188:50530) 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb993fff640 1 -- 172.21.15.188:0/3659744920 learned_addr learned my addr 172.21.15.188:0/3659744920 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb992ffd640 1 -- 172.21.15.188:0/3659744920 >> v2:172.21.15.6:3300/0 conn(0x7fb9940b61e0 msgr2=0x7fb994070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb992ffd640 1 --2- 172.21.15.188:0/3659744920 >> v2:172.21.15.6:3300/0 conn(0x7fb9940b61e0 0x7fb994070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb992ffd640 1 -- 172.21.15.188:0/3659744920 >> v1:172.21.15.6:6789/0 conn(0x7fb9940b5030 legacy=0x7fb994148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.284+0000 7fb992ffd640 1 -- 172.21.15.188:0/3659744920 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940b3f70 con 0x7fb9940b7340 2024-04-26T00:50:18.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb992ffd640 1 --2- 172.21.15.188:0/3659744920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 0x7fb99406ba30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb9880097f0 tx=0x7fb98801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db0010c4569cd76e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb9927fc640 1 -- 172.21.15.188:0/3659744920 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880b0070 con 0x7fb9940b7340 2024-04-26T00:50:18.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb9927fc640 1 -- 172.21.15.188:0/3659744920 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9880ab600 con 0x7fb9940b7340 2024-04-26T00:50:18.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb9927fc640 1 -- 172.21.15.188:0/3659744920 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880ab9d0 con 0x7fb9940b7340 2024-04-26T00:50:18.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- 172.21.15.188:0/3659744920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 msgr2=0x7fb99406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- 172.21.15.188:0/3659744920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 0x7fb99406ba30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb9880097f0 tx=0x7fb98801c480 comp rx=0 tx=0).stop 2024-04-26T00:50:18.295 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- 172.21.15.188:0/3659744920 shutdown_connections 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- 172.21.15.188:0/3659744920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b7340 0x7fb99406ba30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- 172.21.15.188:0/3659744920 >> v2:172.21.15.6:3300/0 conn(0x7fb9940b61e0 0x7fb994070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- 172.21.15.188:0/3659744920 >> 172.21.15.188:0/3659744920 conn(0x7fb99406cb40 msgr2=0x7fb99406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- 172.21.15.188:0/3659744920 shutdown_connections 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- 172.21.15.188:0/3659744920 wait complete. 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 Processor -- start 2024-04-26T00:50:18.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- start start 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9940b5030 0x7fb99413f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 0x7fb994136430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9941524b0 con 0x7fb9940b5030 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb994152330 con 0x7fb9940b7340 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb999fde640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fb994152630 con 0x7fb9940b61e0 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43728/0 (socket says 172.21.15.188:43728) 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 -- 172.21.15.188:0/3018964339 learned_addr learned my addr 172.21.15.188:0/3018964339 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-04-26T00:50:18.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb992ffd640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 0x7fb994136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb9937fe640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9940b5030 0x7fb99413f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 -- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 msgr2=0x7fb994136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 0x7fb994136430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 -- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9940b5030 msgr2=0x7fb99413f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9940b5030 0x7fb99413f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb993fff640 1 -- 172.21.15.188:0/3018964339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994136e00 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.288+0000 7fb992ffd640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 0x7fb994136430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb993fff640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00cb10 tx=0x7fb98c00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c017070 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c00ac70 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941370c0 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c012620 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99413f7e0 con 0x7fb9940b7340 2024-04-26T00:50:18.300 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb98c01a070 con 0x7fb9940b7340 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb98c007490 con 0x7fb9940b7340 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99406db70 con 0x7fb9940b7340 2024-04-26T00:50:18.301 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.292+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb98c021070 con 0x7fb9940b7340 2024-04-26T00:50:18.360 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:18.353+0000 7f388f13f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:50:18.404 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.396+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da9ff617-5bf7-4c67-ab53-42edca7d24a7", "id": 2} v 0) -- 0x7fb9940b4a00 con 0x7fb9940b7340 2024-04-26T00:50:18.412 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb97bfff640 1 -- 172.21.15.188:0/3018964339 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da9ff617-5bf7-4c67-ab53-42edca7d24a7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb98c007070 con 0x7fb9940b7340 2024-04-26T00:50:18.412 INFO:teuthology.orchestra.run.smithi188.stdout:2 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 10 mgrc shutdown 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 msgr2=0x7fb994143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00cb10 tx=0x7fb98c00a060 comp rx=0 tx=0).stop 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 shutdown_connections 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9940b7340 0x7fb994143f70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb9940b61e0 0x7fb994136430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.413 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 --2- 172.21.15.188:0/3018964339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9940b5030 0x7fb99413f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 >> 172.21.15.188:0/3018964339 conn(0x7fb99406cb40 msgr2=0x7fb9940a7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 shutdown_connections 2024-04-26T00:50:18.414 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.404+0000 7fb999fde640 1 -- 172.21.15.188:0/3018964339 wait complete. 2024-04-26T00:50:18.429 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 92e37cac-6413-45ff-8912-5aa5cf9b15ed 3 2024-04-26T00:50:18.452 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:18.444+0000 7fd07b1ec180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:50:18.452 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:18.444+0000 7fe3cf4b5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:50:18.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 Processor -- start 2024-04-26T00:50:18.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 -- start start 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5eb80a7ab0 0x7f5eb80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5eb80717a0 0x7f5eb8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb80ab1c0 con 0x7f5eb813b690 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb8137690 con 0x7f5eb80a7ab0 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5ebdd54640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb80aaab0 con 0x7f5eb80717a0 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb7fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5eb80717a0 0x7f5eb8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb6ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f5eb813b690 0x7f5eb80b9270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:58650/0 (socket says 172.21.15.188:58650) 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb6ffd640 1 -- 172.21.15.188:0/1788267625 learned_addr learned my addr 172.21.15.188:0/1788267625 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb77fe640 1 --2- 172.21.15.188:0/1788267625 >> v2:172.21.15.6:3300/0 conn(0x7f5eb80a7ab0 0x7f5eb80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb7fff640 1 -- 172.21.15.188:0/1788267625 >> v2:172.21.15.6:3300/0 conn(0x7f5eb80a7ab0 msgr2=0x7f5eb80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb7fff640 1 --2- 172.21.15.188:0/1788267625 >> v2:172.21.15.6:3300/0 conn(0x7f5eb80a7ab0 0x7f5eb80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb7fff640 1 -- 172.21.15.188:0/1788267625 >> v1:172.21.15.188:6789/0 conn(0x7f5eb813b690 legacy=0x7f5eb80b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb67fc640 1 -- 172.21.15.188:0/1788267625 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129366356 0 0) 0x7f5eb80ab1c0 con 0x7f5eb813b690 2024-04-26T00:50:18.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.532+0000 7f5eb7fff640 1 -- 172.21.15.188:0/1788267625 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb8137930 con 0x7f5eb80717a0 2024-04-26T00:50:18.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5eb7fff640 1 --2- 172.21.15.188:0/1788267625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb80717a0 0x7f5eb8071bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eb813ba70 tx=0x7f5ea801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faa17a8594638e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5eb67fc640 1 -- 172.21.15.188:0/1788267625 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80b0070 con 0x7f5eb80717a0 2024-04-26T00:50:18.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5eb67fc640 1 -- 172.21.15.188:0/1788267625 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb80a80a0 con 0x7f5eb80717a0 2024-04-26T00:50:18.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5eb67fc640 1 -- 172.21.15.188:0/1788267625 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80ab820 con 0x7f5eb80717a0 2024-04-26T00:50:18.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 -- 172.21.15.188:0/1788267625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb80717a0 msgr2=0x7f5eb8071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/1788267625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb80717a0 0x7f5eb8071bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eb813ba70 tx=0x7f5ea801c3d0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 -- 172.21.15.188:0/1788267625 shutdown_connections 2024-04-26T00:50:18.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/1788267625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb80717a0 0x7f5eb8071bb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/1788267625 >> v2:172.21.15.6:3300/0 conn(0x7f5eb80a7ab0 0x7f5eb80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 -- 172.21.15.188:0/1788267625 >> 172.21.15.188:0/1788267625 conn(0x7f5eb8070610 msgr2=0x7f5eb80b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 -- 172.21.15.188:0/1788267625 shutdown_connections 2024-04-26T00:50:18.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.536+0000 7f5ebdd54640 1 -- 172.21.15.188:0/1788267625 wait complete. 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 Processor -- start 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- start start 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5eb80717a0 0x7f5eb80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb80a7ab0 0x7f5eb80b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8152430 con 0x7f5eb80a7ab0 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81522b0 con 0x7f5eb813b690 2024-04-26T00:50:18.549 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb81525b0 con 0x7f5eb80717a0 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43744/0 (socket says 172.21.15.188:43744) 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 -- 172.21.15.188:0/3585942501 learned_addr learned my addr 172.21.15.188:0/3585942501 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb77fe640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5eb80717a0 0x7f5eb80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb6ffd640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb80a7ab0 0x7f5eb80b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 -- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5eb80717a0 msgr2=0x7f5eb80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5eb80717a0 0x7f5eb80b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 -- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb80a7ab0 msgr2=0x7f5eb80b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb80a7ab0 0x7f5eb80b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 -- 172.21.15.188:0/3585942501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb80a7640 con 0x7f5eb813b690 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eb7fff640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ea801c8b0 tx=0x7f5ea8019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80b0040 con 0x7f5eb813b690 2024-04-26T00:50:18.550 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea80b9070 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80b4850 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb80b2cd0 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb80b1f10 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ea80b49f0 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5ea80bed60 con 0x7f5eb813b690 2024-04-26T00:50:18.551 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.540+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb806fed0 con 0x7f5eb813b690 2024-04-26T00:50:18.552 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.544+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5ea8016050 con 0x7f5eb813b690 2024-04-26T00:50:18.618 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.608+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92e37cac-6413-45ff-8912-5aa5cf9b15ed", "id": 3} v 0) -- 0x7f5eb806db30 con 0x7f5eb813b690 2024-04-26T00:50:18.626 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5eaffff640 1 -- 172.21.15.188:0/3585942501 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92e37cac-6413-45ff-8912-5aa5cf9b15ed", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5ea80b4dd0 con 0x7f5eb813b690 2024-04-26T00:50:18.626 INFO:teuthology.orchestra.run.smithi188.stdout:3 2024-04-26T00:50:18.627 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 10 mgrc shutdown 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 msgr2=0x7f5eb8144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ea801c8b0 tx=0x7f5ea8019170 comp rx=0 tx=0).stop 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 shutdown_connections 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb813b690 0x7f5eb8144e70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb80a7ab0 0x7f5eb80b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 --2- 172.21.15.188:0/3585942501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5eb80717a0 0x7f5eb80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 >> 172.21.15.188:0/3585942501 conn(0x7f5eb8070610 msgr2=0x7f5eb806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 shutdown_connections 2024-04-26T00:50:18.628 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-26T00:50:18.620+0000 7f5ebdd54640 1 -- 172.21.15.188:0/3585942501 wait complete. 2024-04-26T00:50:18.643 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T00:50:18.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T00:50:18.646 INFO:tasks.ceph.osd.0:Started 2024-04-26T00:50:18.646 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T00:50:18.646 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T00:50:18.687 INFO:tasks.ceph.osd.1:Started 2024-04-26T00:50:18.688 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T00:50:18.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T00:50:18.690 INFO:tasks.ceph.osd.2:Started 2024-04-26T00:50:18.690 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T00:50:18.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T00:50:18.692 INFO:tasks.ceph.osd.3:Started 2024-04-26T00:50:18.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 Processor -- start 2024-04-26T00:50:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 -- start start 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5728071ca0 0x7f5728150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572806d8f0 con 0x7f57281380d0 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57281377a0 con 0x7f5728070180 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f572da5d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5728137a60 con 0x7f5728071ca0 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f5726ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57281380d0 0x7f572806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55674/0 (socket says 172.21.15.6:55674) 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f5726ffd640 1 -- 172.21.15.6:0/3971005249 learned_addr learned my addr 172.21.15.6:0/3971005249 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57277fe640 1 --2- 172.21.15.6:0/3971005249 >> v2:172.21.15.188:3300/0 conn(0x7f5728071ca0 0x7f5728150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57267fc640 1 -- 172.21.15.6:0/3971005249 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964553378 0 0) 0x7f572806d8f0 con 0x7f57281380d0 2024-04-26T00:50:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57267fc640 1 -- 172.21.15.6:0/3971005249 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5714003530 con 0x7f57281380d0 2024-04-26T00:50:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57277fe640 1 -- 172.21.15.6:0/3971005249 >> v1:172.21.15.188:6789/0 conn(0x7f5728070180 legacy=0x7f5728071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57277fe640 1 -- 172.21.15.6:0/3971005249 >> v1:172.21.15.6:6789/0 conn(0x7f57281380d0 legacy=0x7f572806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57277fe640 1 -- 172.21.15.6:0/3971005249 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57281384b0 con 0x7f5728071ca0 2024-04-26T00:50:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57277fe640 1 --2- 172.21.15.6:0/3971005249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f5728150950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5720009d90 tx=0x7f572001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b829d7d1258b6128 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57267fc640 1 -- 172.21.15.6:0/3971005249 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200b2070 con 0x7f5728071ca0 2024-04-26T00:50:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57267fc640 1 -- 172.21.15.6:0/3971005249 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57200a5780 con 0x7f5728071ca0 2024-04-26T00:50:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.797+0000 7f57267fc640 1 -- 172.21.15.6:0/3971005249 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200a5b50 con 0x7f5728071ca0 2024-04-26T00:50:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3971005249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 msgr2=0x7f5728150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 --2- 172.21.15.6:0/3971005249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f5728150950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5720009d90 tx=0x7f572001c8c0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3971005249 shutdown_connections 2024-04-26T00:50:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 --2- 172.21.15.6:0/3971005249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f5728150950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3971005249 >> 172.21.15.6:0/3971005249 conn(0x7f572806cb40 msgr2=0x7f572806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3971005249 shutdown_connections 2024-04-26T00:50:18.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3971005249 wait complete. 2024-04-26T00:50:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 Processor -- start 2024-04-26T00:50:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- start start 2024-04-26T00:50:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728070180 0x7f5728145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f57280a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f57281538c0 con 0x7f5728070180 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5728070590 con 0x7f5728071ca0 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5728153a40 con 0x7f57281380d0 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5726ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728070180 0x7f5728145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:41138/0 (socket says 172.21.15.6:41138) 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 -- 172.21.15.6:0/3262302532 learned_addr learned my addr 172.21.15.6:0/3262302532 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f571ffff640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f57280a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 -- 172.21.15.6:0/3262302532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 msgr2=0x7f57280a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f57280a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 -- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728070180 msgr2=0x7f5728145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728070180 0x7f5728145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 -- 172.21.15.6:0/3262302532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57280a4080 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f57277fe640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f572001a4f0 tx=0x7f5720019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200bd020 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57200a5e30 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57280a5510 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200b2040 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f572809a8d0 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57200c0020 con 0x7f57281380d0 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f57200b8b00 con 0x7f57281380d0 2024-04-26T00:50:18.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.801+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572806db70 con 0x7f57281380d0 2024-04-26T00:50:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.813+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f57200c7030 con 0x7f57281380d0 2024-04-26T00:50:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.869+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f572813a6d0 con 0x7f57281380d0 2024-04-26T00:50:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f5724ff9640 1 -- 172.21.15.6:0/3262302532 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5720016540 con 0x7f57281380d0 2024-04-26T00:50:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:18.615769+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 10 mgrc shutdown 2024-04-26T00:50:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 msgr2=0x7f572809a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f572001a4f0 tx=0x7f5720019660 comp rx=0 tx=0).stop 2024-04-26T00:50:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 shutdown_connections 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57281380d0 0x7f572809a390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5728071ca0 0x7f57280a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 --2- 172.21.15.6:0/3262302532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728070180 0x7f5728145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 >> 172.21.15.6:0/3262302532 conn(0x7f572806cb40 msgr2=0x7f57280a63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 shutdown_connections 2024-04-26T00:50:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:18.873+0000 7f572da5d640 1 -- 172.21.15.6:0/3262302532 wait complete. 2024-04-26T00:50:18.896 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T00:50:18.896 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T00:50:18.936 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:18.929+0000 7f388f13f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:18.993 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:18.985+0000 7f388f13f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:50:19.031 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.024+0000 7fd07b1ec180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:19.032 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.024+0000 7fe3cf4b5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:19.047 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.041+0000 7f388f13f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:50:19.087 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.080+0000 7fe3cf4b5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:50:19.088 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.080+0000 7fd07b1ec180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:50:19.127 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.121+0000 7f388f13f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:50:19.141 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.132+0000 7fd07b1ec180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:50:19.141 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.132+0000 7fe3cf4b5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:50:19.181 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.173+0000 7f388f13f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:50:19.220 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.212+0000 7fd07b1ec180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:50:19.220 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.212+0000 7fe3cf4b5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:50:19.261 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.253+0000 7f388f13f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:50:19.273 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.264+0000 7fd07b1ec180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:50:19.273 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.264+0000 7fe3cf4b5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:50:19.276 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-04-26T00:50:19.269+0000 7fbcfe6847c0 -1 Falling back to public interface 2024-04-26T00:50:19.299 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:19.303 INFO:tasks.ceph.osd.1.smithi188.stderr:2024-04-26T00:50:19.296+0000 7f00f92a07c0 -1 Falling back to public interface 2024-04-26T00:50:19.318 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.309+0000 7f388f13f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:50:19.323 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-26T00:50:19.316+0000 7f28093e97c0 -1 Falling back to public interface 2024-04-26T00:50:19.323 INFO:tasks.ceph.osd.3.smithi188.stderr:2024-04-26T00:50:19.316+0000 7f48592cd7c0 -1 Falling back to public interface 2024-04-26T00:50:19.354 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.344+0000 7fd07b1ec180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:50:19.355 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.348+0000 7fe3cf4b5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:50:19.409 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.400+0000 7fd07b1ec180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:50:19.409 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.400+0000 7fe3cf4b5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:50:19.411 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 Processor -- start 2024-04-26T00:50:19.411 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 -- start start 2024-04-26T00:50:19.412 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14c1486a0 con 0x7ff14c0a9070 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff14c148960 con 0x7ff14c0a81f0 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff151059640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c0a8b90 con 0x7ff14c1491a0 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:41150/0 (socket says 172.21.15.6:41150) 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58212/0 (socket says 172.21.15.6:58212) 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 -- 172.21.15.6:0/81712532 learned_addr learned my addr 172.21.15.6:0/81712532 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:19.413 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 -- 172.21.15.6:0/81712532 >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 msgr2=0x7ff14c0a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:19.414 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 --2- 172.21.15.6:0/81712532 >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.414 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 -- 172.21.15.6:0/81712532 >> v1:172.21.15.188:6789/0 conn(0x7ff14c0a9070 legacy=0x7ff14c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:19.414 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14ad9d640 1 -- 172.21.15.6:0/81712532 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c0a5f30 con 0x7ff14c1491a0 2024-04-26T00:50:19.414 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.405+0000 7ff14b59e640 1 --2- 172.21.15.6:0/81712532 >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- 172.21.15.6:0/81712532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164c7b1d151bc5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff149d9b640 1 -- 172.21.15.6:0/81712532 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0b0070 con 0x7ff14c1491a0 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff149d9b640 1 -- 172.21.15.6:0/81712532 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c0ab600 con 0x7ff14c1491a0 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff149d9b640 1 -- 172.21.15.6:0/81712532 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ab9d0 con 0x7ff14c1491a0 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/81712532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 msgr2=0x7ff14c13b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:19.416 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- 172.21.15.6:0/81712532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c4b0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/81712532 shutdown_connections 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- 172.21.15.6:0/81712532 >> v2:172.21.15.6:3300/0 conn(0x7ff14c0a81f0 0x7ff14c0a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- 172.21.15.6:0/81712532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c1491a0 0x7ff14c13b450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/81712532 >> 172.21.15.6:0/81712532 conn(0x7ff14c0a6a30 msgr2=0x7ff14c0a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/81712532 shutdown_connections 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/81712532 wait complete. 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 Processor -- start 2024-04-26T00:50:19.417 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- start start 2024-04-26T00:50:19.419 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff14c0a9070 0x7ff14c139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff14c1491a0 0x7ff14c0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1524e0 con 0x7ff14c0a9070 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c152360 con 0x7ff14c1491a0 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ff14c152660 con 0x7ff14c0a81f0 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:41162/0 (socket says 172.21.15.6:41162) 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 -- 172.21.15.6:0/3171515850 learned_addr learned my addr 172.21.15.6:0/3171515850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14a59c640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff14c0a9070 0x7ff14c139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14b59e640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff14c1491a0 0x7ff14c0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 -- 172.21.15.6:0/3171515850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff14c1491a0 msgr2=0x7ff14c0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:19.420 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff14c1491a0 0x7ff14c0b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 -- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff14c0a9070 msgr2=0x7ff14c139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff14c0a9070 0x7ff14c139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 -- 172.21.15.6:0/3171515850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c0b7c30 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff14ad9d640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ae040 tx=0x7ff13c01acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ba020 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c0aa7d0 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0b0040 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c0a0730 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c09fbf0 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff13c0bd020 con 0x7ff14c0a81f0 2024-04-26T00:50:19.421 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 4 mgrc handle_mgr_map Got map version 1 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.409+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff13c0b6c90 con 0x7ff14c0a81f0 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.413+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c068470 con 0x7ff14c0a81f0 2024-04-26T00:50:19.422 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.413+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff13c0c4030 con 0x7ff14c0a81f0 2024-04-26T00:50:19.478 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.469+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff14c147580 con 0x7ff14c0a81f0 2024-04-26T00:50:19.478 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff1437fe640 1 -- 172.21.15.6:0/3171515850 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7ff13c016130 con 0x7ff14c0a81f0 2024-04-26T00:50:19.478 INFO:teuthology.misc.health.smithi006.stdout: 2024-04-26T00:50:19.479 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":6,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:18.615769+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:19.479 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.473+0000 7f388f13f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:50:19.480 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 10 mgrc shutdown 2024-04-26T00:50:19.480 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 msgr2=0x7ff14c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:19.480 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ae040 tx=0x7ff13c01acf0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 shutdown_connections 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff14c1491a0 0x7ff14c0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff14c0a9070 0x7ff14c139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 --2- 172.21.15.6:0/3171515850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff14c0a81f0 0x7ff14c0b1b90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 >> 172.21.15.6:0/3171515850 conn(0x7ff14c0a6a30 msgr2=0x7ff14c1361f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 shutdown_connections 2024-04-26T00:50:19.481 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:19.473+0000 7ff151059640 1 -- 172.21.15.6:0/3171515850 wait complete. 2024-04-26T00:50:19.494 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T00:50:19.544 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:19.537+0000 7f388f13f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:50:19.562 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.552+0000 7fd07b1ec180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:50:19.562 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.556+0000 7fe3cf4b5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:50:19.624 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:19.616+0000 7fd07b1ec180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:50:19.625 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:19.616+0000 7fe3cf4b5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:50:20.174 INFO:tasks.ceph.mgr.x.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:50:20.175 INFO:tasks.ceph.mgr.x.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:50:20.175 INFO:tasks.ceph.mgr.x.smithi006.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:50:20.242 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:20.237+0000 7f388f13f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:50:20.427 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:20.421+0000 7f388f13f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:20.595 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:20.589+0000 7f388f13f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:20.650 INFO:tasks.ceph.mgr.y.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:50:20.650 INFO:tasks.ceph.mgr.y.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:50:20.650 INFO:tasks.ceph.mgr.y.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:50:20.651 INFO:tasks.ceph.mgr.z.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:50:20.651 INFO:tasks.ceph.mgr.z.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:50:20.651 INFO:tasks.ceph.mgr.z.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:50:20.666 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:20.661+0000 7f388f13f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:50:20.728 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:20.720+0000 7fe3cf4b5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:50:20.729 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:20.720+0000 7fd07b1ec180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:50:20.817 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:20.809+0000 7f388f13f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:20.909 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:20.900+0000 7fe3cf4b5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:20.913 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:20.904+0000 7fd07b1ec180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:20.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:50:20.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:50:21.081 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:21.072+0000 7fe3cf4b5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:21.082 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:21.076+0000 7fd07b1ec180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:50:21.147 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:21.140+0000 7fe3cf4b5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:50:21.149 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:21.140+0000 7fd07b1ec180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:50:21.284 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:21.276+0000 7fe3cf4b5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:21.291 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:21.284+0000 7fd07b1ec180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:50:21.491 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:21.485+0000 7f388f13f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:50:21.570 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:21.561+0000 7f388f13f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:50:21.760 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:21.753+0000 7f388f13f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:50:21.837 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:21.829+0000 7f388f13f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:50:21.922 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:21.916+0000 7fe3cf4b5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:50:21.922 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:21.916+0000 7fd07b1ec180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:50:21.999 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:21.992+0000 7fd07b1ec180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:50:21.999 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:21.992+0000 7fe3cf4b5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:50:22.143 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:22.137+0000 7f388f13f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:50:22.196 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:22.188+0000 7fd07b1ec180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:50:22.196 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:22.188+0000 7fe3cf4b5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:50:22.213 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:22.205+0000 7f388f13f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:50:22.272 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:22.264+0000 7fe3cf4b5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:50:22.273 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:22.264+0000 7fd07b1ec180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:50:22.644 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:22.636+0000 7fd07b1ec180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:50:22.648 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:22.640+0000 7fe3cf4b5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:50:22.707 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:50:22.700+0000 7fd07b1ec180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:50:22.708 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:50:22.700+0000 7fe3cf4b5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:50:22.857 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-04-26T00:50:22.849+0000 7fbcfe6847c0 -1 osd.0 0 log_to_monitors true 2024-04-26T00:50:23.167 INFO:tasks.ceph.osd.1.smithi188.stderr:2024-04-26T00:50:23.160+0000 7f00f92a07c0 -1 osd.1 0 log_to_monitors true 2024-04-26T00:50:23.190 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-26T00:50:23.180+0000 7f28093e97c0 -1 osd.2 0 log_to_monitors true 2024-04-26T00:50:23.201 INFO:tasks.ceph.osd.3.smithi188.stderr:2024-04-26T00:50:23.192+0000 7f48592cd7c0 -1 osd.3 0 log_to_monitors true 2024-04-26T00:50:23.255 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:23.249+0000 7f3836489640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T00:50:23.266 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:50:23.261+0000 7f3836489640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T00:50:25.612 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-04-26T00:50:25.605+0000 7fbcf9e0a640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T00:50:25.638 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-04-26T00:50:25.629+0000 7fbcf2451640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T00:50:25.899 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:26.023 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 Processor -- start 2024-04-26T00:50:26.023 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 -- start start 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 0x7fda98146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 0x7fda98146a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fda980a6800 con 0x7fda98074b00 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fda980a94c0 con 0x7fda980a5b50 2024-04-26T00:50:26.024 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9c9c0640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fda980a9780 con 0x7fda980a9020 2024-04-26T00:50:26.025 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.025 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda95d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 0x7fda98146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:41234/0 (socket says 172.21.15.6:41234) 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 -- 172.21.15.6:0/2564465857 learned_addr learned my addr 172.21.15.6:0/2564465857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9659c640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 0x7fda98146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 -- 172.21.15.6:0/2564465857 >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 msgr2=0x7fda98146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 0x7fda98146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 -- 172.21.15.6:0/2564465857 >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 msgr2=0x7fda98146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 0x7fda98146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda96d9d640 1 -- 172.21.15.6:0/2564465857 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda980a5f30 con 0x7fda980a9020 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda9659c640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 0x7fda98146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:26.026 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.017+0000 7fda95d9b640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 0x7fda98146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:26.027 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda96d9d640 1 --2- 172.21.15.6:0/2564465857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda980b8cd0 tx=0x7fda9001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d0cfef3cc71798 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:26.027 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9559a640 1 -- 172.21.15.6:0/2564465857 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900a57e0 con 0x7fda980a9020 2024-04-26T00:50:26.027 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9559a640 1 -- 172.21.15.6:0/2564465857 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda981471b0 con 0x7fda980a9020 2024-04-26T00:50:26.027 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9559a640 1 -- 172.21.15.6:0/2564465857 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda900a5ba0 con 0x7fda980a9020 2024-04-26T00:50:26.028 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- 172.21.15.6:0/2564465857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 msgr2=0x7fda980a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:26.028 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/2564465857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda980b8cd0 tx=0x7fda9001c940 comp rx=0 tx=0).stop 2024-04-26T00:50:26.028 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- 172.21.15.6:0/2564465857 shutdown_connections 2024-04-26T00:50:26.028 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.6:3300/0 conn(0x7fda98074b00 0x7fda98146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.029 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/2564465857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a9020 0x7fda980a7f60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.029 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/2564465857 >> v2:172.21.15.188:3300/0 conn(0x7fda980a5b50 0x7fda98146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.029 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- 172.21.15.6:0/2564465857 >> 172.21.15.6:0/2564465857 conn(0x7fda98072e70 msgr2=0x7fda98073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:26.029 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- 172.21.15.6:0/2564465857 shutdown_connections 2024-04-26T00:50:26.029 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- 172.21.15.6:0/2564465857 wait complete. 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 Processor -- start 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- start start 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda98074b00 0x7fda981458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 0x7fda9813c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fda98142ad0 con 0x7fda980a9020 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fda98142950 con 0x7fda98074b00 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9c9c0640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fda98142c50 con 0x7fda980a5b50 2024-04-26T00:50:26.031 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda96d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 0x7fda9813c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:41238/0 (socket says 172.21.15.6:41238) 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 -- 172.21.15.6:0/3394299312 learned_addr learned my addr 172.21.15.6:0/3394299312 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda9659c640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda98074b00 0x7fda981458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 -- 172.21.15.6:0/3394299312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda98074b00 msgr2=0x7fda981458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda98074b00 0x7fda981458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.021+0000 7fda95d9b640 1 -- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 msgr2=0x7fda9813c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda95d9b640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 0x7fda9813c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda95d9b640 1 -- 172.21.15.6:0/3394299312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9813cf80 con 0x7fda980a5b50 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda96d9d640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 0x7fda9813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda95d9b640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ec10 tx=0x7fda8c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c017070 con 0x7fda980a5b50 2024-04-26T00:50:26.032 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c00cc30 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9813d240 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c013470 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda98140550 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda98068470 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) ==== 130781+0+0 (secure 0 0 0) 0x7fda8c01a070 con 0x7fda980a5b50 2024-04-26T00:50:26.033 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 20 mgrc handle_mgr_map mgrmap(e 4) 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 4 mgrc handle_mgr_map Got map version 4 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 0x7fda7809b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda9659c640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 0x7fda7809b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:26.034 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.025+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7fda8c0c1e30 con 0x7fda980a5b50 2024-04-26T00:50:26.035 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.029+0000 7fda9659c640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 0x7fda7809b820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda88006e90 tx=0x7fda88008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:26.037 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.029+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fda8c093240 con 0x7fda980a5b50 2024-04-26T00:50:26.165 INFO:tasks.ceph.osd.1.smithi188.stderr:2024-04-26T00:50:26.156+0000 7f00f4a26640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T00:50:26.183 INFO:tasks.ceph.osd.1.smithi188.stderr:2024-04-26T00:50:26.176+0000 7f00ed06d640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T00:50:26.203 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.197+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda980b9530 con 0x7fda980a5b50 2024-04-26T00:50:26.204 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.197+0000 7fda86ffd640 1 -- 172.21.15.6:0/3394299312 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fda8c097540 con 0x7fda980a5b50 2024-04-26T00:50:26.204 INFO:teuthology.misc.health.smithi006.stdout: 2024-04-26T00:50:26.205 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":8,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:24.310447+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.197+0000 7fda9c9c0640 10 mgrc shutdown 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 msgr2=0x7fda7809b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 0x7fda7809b820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda88006e90 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 msgr2=0x7fda9809a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ec10 tx=0x7fda8c00c520 comp rx=0 tx=0).stop 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 shutdown_connections 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fda78099360 0x7fda7809b820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.207 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda980a9020 0x7fda9813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.208 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda980a5b50 0x7fda9809a570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.208 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 --2- 172.21.15.6:0/3394299312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fda98074b00 0x7fda981458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:26.208 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 >> 172.21.15.6:0/3394299312 conn(0x7fda98072e70 msgr2=0x7fda980b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:26.208 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 shutdown_connections 2024-04-26T00:50:26.208 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:26.201+0000 7fda9c9c0640 1 -- 172.21.15.6:0/3394299312 wait complete. 2024-04-26T00:50:26.212 INFO:tasks.ceph.osd.3.smithi188.stderr:2024-04-26T00:50:26.204+0000 7f4856289640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T00:50:26.212 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-26T00:50:26.204+0000 7f2804b6f640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T00:50:26.224 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T00:50:26.247 INFO:tasks.ceph.osd.3.smithi188.stderr:2024-04-26T00:50:26.240+0000 7f484d09a640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T00:50:26.254 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-26T00:50:26.248+0000 7f27fd1b6640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T00:50:32.628 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:32.758 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.748+0000 7f0d5dbb3640 1 Processor -- start 2024-04-26T00:50:32.758 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.748+0000 7f0d5dbb3640 1 -- start start 2024-04-26T00:50:32.759 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.759 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0d581424b0 0x7f0d5814c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d581429b0 con 0x7f0d58145220 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0d580a6690 con 0x7f0d581424b0 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0d58142c70 con 0x7f0d580a62b0 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:46962/0 (socket says 172.21.15.6:46962) 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 -- 172.21.15.6:0/1231479709 learned_addr learned my addr 172.21.15.6:0/1231479709 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d56ffd640 1 --1- 172.21.15.6:0/1231479709 >> v1:172.21.15.6:6789/0 conn(0x7f0d58145220 0x7f0d58145620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56916/0 (socket says 172.21.15.6:56916) 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 -- 172.21.15.6:0/1231479709 >> v2:172.21.15.188:3300/0 conn(0x7f0d581424b0 msgr2=0x7f0d5814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 --2- 172.21.15.6:0/1231479709 >> v2:172.21.15.188:3300/0 conn(0x7f0d581424b0 0x7f0d5814c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 -- 172.21.15.6:0/1231479709 >> v1:172.21.15.6:6789/0 conn(0x7f0d58145220 legacy=0x7f0d58145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.760 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d567fc640 1 -- 172.21.15.6:0/1231479709 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103089205 0 0) 0x7f0d581429b0 con 0x7f0d58145220 2024-04-26T00:50:32.761 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 -- 172.21.15.6:0/1231479709 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580a0af0 con 0x7f0d580a62b0 2024-04-26T00:50:32.762 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d577fe640 1 --2- 172.21.15.6:0/1231479709 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d4801e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c0d65f63733935 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:32.762 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d567fc640 1 -- 172.21.15.6:0/1231479709 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480b3070 con 0x7f0d580a62b0 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d567fc640 1 -- 172.21.15.6:0/1231479709 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d480ae630 con 0x7f0d580a62b0 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d567fc640 1 -- 172.21.15.6:0/1231479709 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480aa050 con 0x7f0d580a62b0 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/1231479709 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 msgr2=0x7f0d580a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/1231479709 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d4801e6c0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/1231479709 shutdown_connections 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/1231479709 >> v2:172.21.15.188:3300/0 conn(0x7f0d581424b0 0x7f0d5814c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/1231479709 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d580a62b0 0x7f0d580a05b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/1231479709 >> 172.21.15.6:0/1231479709 conn(0x7f0d58074660 msgr2=0x7f0d580a5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:32.763 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.752+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/1231479709 shutdown_connections 2024-04-26T00:50:32.764 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/1231479709 wait complete. 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 Processor -- start 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- start start 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d58145220 0x7f0d581dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5806d200 con 0x7f0d580a62b0 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5806d080 con 0x7f0d58145220 2024-04-26T00:50:32.767 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5806d380 con 0x7f0d581424b0 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49728/0 (socket says 172.21.15.6:49728) 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d577fe640 1 -- 172.21.15.6:0/3783777783 learned_addr learned my addr 172.21.15.6:0/3783777783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:46964/0 (socket says 172.21.15.6:46964) 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d57fff640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d58145220 0x7f0d581dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 -- 172.21.15.6:0/3783777783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d58145220 msgr2=0x7f0d581dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.768 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d58145220 0x7f0d581dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 -- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 msgr2=0x7f0d580b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 -- 172.21.15.6:0/3783777783 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5813ae20 con 0x7f0d581424b0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d577fe640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d56ffd640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c430 tx=0x7f0d4c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0074e0 con 0x7f0d581424b0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0047f0 con 0x7f0d581424b0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d580b46a0 con 0x7f0d581424b0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c004be0 con 0x7f0d581424b0 2024-04-26T00:50:32.769 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d58140c70 con 0x7f0d581424b0 2024-04-26T00:50:32.770 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.756+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5804f580 con 0x7f0d581424b0 2024-04-26T00:50:32.770 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f0d4c011070 con 0x7f0d581424b0 2024-04-26T00:50:32.770 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 0x7f0d4409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d577fe640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 0x7f0d4409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f0d4c0c2060 con 0x7f0d581424b0 2024-04-26T00:50:32.771 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.760+0000 7f0d577fe640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 0x7f0d4409b800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d48008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:32.772 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.764+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0d4c0934a0 con 0x7f0d581424b0 2024-04-26T00:50:32.934 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.924+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d580a5430 con 0x7f0d581424b0 2024-04-26T00:50:32.934 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d3ffff640 1 -- 172.21.15.6:0/3783777783 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7951 (secure 0 0 0) 0x7f0d4c092da0 con 0x7f0d581424b0 2024-04-26T00:50:32.935 INFO:teuthology.misc.health.smithi006.stdout: 2024-04-26T00:50:32.935 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":13,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:30.645077+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:32.937 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 10 mgrc shutdown 2024-04-26T00:50:32.937 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 msgr2=0x7f0d4409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.937 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 0x7f0d4409b800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d48008040 comp rx=0 tx=0).stop 2024-04-26T00:50:32.937 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 msgr2=0x7f0d581dca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:32.937 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c430 tx=0x7f0d4c00c8f0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 shutdown_connections 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0d44099340 0x7f0d4409b800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d58145220 0x7f0d581dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d581424b0 0x7f0d581dca70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 --2- 172.21.15.6:0/3783777783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d580a62b0 0x7f0d580b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 >> 172.21.15.6:0/3783777783 conn(0x7f0d58074660 msgr2=0x7f0d580a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 shutdown_connections 2024-04-26T00:50:32.938 INFO:teuthology.misc.health.smithi006.stderr:2024-04-26T00:50:32.928+0000 7f0d5dbb3640 1 -- 172.21.15.6:0/3783777783 wait complete. 2024-04-26T00:50:32.953 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-26T00:50:32.953 INFO:tasks.ceph:Creating RBD pool 2024-04-26T00:50:32.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T00:50:33.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 Processor -- start 2024-04-26T00:50:33.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 -- start start 2024-04-26T00:50:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 0x7f32780aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f327814b620 0x7f327814da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32780a8120 con 0x7f3278072910 2024-04-26T00:50:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3278071310 con 0x7f327814b620 2024-04-26T00:50:33.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327f2bb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f3278072fc0 con 0x7f32780a5a90 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d858640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f327814b620 0x7f327814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327c856640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3278072910 0x7f32780b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56932/0 (socket says 172.21.15.6:56932) 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327c856640 1 -- 172.21.15.6:0/3138662483 learned_addr learned my addr 172.21.15.6:0/3138662483 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d057640 1 --2- 172.21.15.6:0/3138662483 >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 0x7f32780aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d858640 1 -- 172.21.15.6:0/3138662483 >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 msgr2=0x7f32780aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d858640 1 --2- 172.21.15.6:0/3138662483 >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 0x7f32780aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d858640 1 -- 172.21.15.6:0/3138662483 >> v1:172.21.15.6:6789/0 conn(0x7f3278072910 legacy=0x7f32780b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d858640 1 -- 172.21.15.6:0/3138662483 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780aaa90 con 0x7f327814b620 2024-04-26T00:50:33.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.072+0000 7f327d057640 1 --2- 172.21.15.6:0/3138662483 >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 0x7f32780aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:33.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327d858640 1 --2- 172.21.15.6:0/3138662483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327814b620 0x7f327814da10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f327806d080 tx=0x7f327001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac360d98f097f710 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f326ffff640 1 -- 172.21.15.6:0/3138662483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b2070 con 0x7f327814b620 2024-04-26T00:50:33.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f326ffff640 1 -- 172.21.15.6:0/3138662483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700a5960 con 0x7f327814b620 2024-04-26T00:50:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f326ffff640 1 -- 172.21.15.6:0/3138662483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700a5d30 con 0x7f327814b620 2024-04-26T00:50:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- 172.21.15.6:0/3138662483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327814b620 msgr2=0x7f327814da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- 172.21.15.6:0/3138662483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327814b620 0x7f327814da10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f327806d080 tx=0x7f327001c880 comp rx=0 tx=0).stop 2024-04-26T00:50:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- 172.21.15.6:0/3138662483 shutdown_connections 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- 172.21.15.6:0/3138662483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327814b620 0x7f327814da10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- 172.21.15.6:0/3138662483 >> v2:172.21.15.188:3300/0 conn(0x7f32780a5a90 0x7f32780aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- 172.21.15.6:0/3138662483 >> 172.21.15.6:0/3138662483 conn(0x7f327806e7b0 msgr2=0x7f32780b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- 172.21.15.6:0/3138662483 shutdown_connections 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- 172.21.15.6:0/3138662483 wait complete. 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 Processor -- start 2024-04-26T00:50:33.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- start start 2024-04-26T00:50:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32780a5a90 0x7f32781443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f327814b620 0x7f327809e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3278139420 con 0x7f32781454b0 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32781395a0 con 0x7f32780a5a90 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327f2bb640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f3278150770 con 0x7f327814b620 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327d858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327d858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49756/0 (socket says 172.21.15.6:49756) 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327d858640 1 -- 172.21.15.6:0/2566341891 learned_addr learned my addr 172.21.15.6:0/2566341891 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.076+0000 7f327c856640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f327814b620 0x7f327809e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d057640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32780a5a90 0x7f32781443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 -- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f327814b620 msgr2=0x7f327809e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f327814b620 0x7f327809e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 -- 172.21.15.6:0/2566341891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32780a5a90 msgr2=0x7f32781443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32780a5a90 0x7f32781443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 -- 172.21.15.6:0/2566341891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3278145940 con 0x7f32781454b0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d858640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32700b0040 tx=0x7f3270019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700b2050 con 0x7f32781454b0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700be070 con 0x7f32781454b0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3278145be0 con 0x7f32781454b0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700ade40 con 0x7f32781454b0 2024-04-26T00:50:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3278144cd0 con 0x7f32781454b0 2024-04-26T00:50:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327809dce0 con 0x7f32781454b0 2024-04-26T00:50:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f32700c3460 con 0x7f32781454b0 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 0x7f325c09b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f327015ddc0 con 0x7f32781454b0 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d057640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 0x7f325c09b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.080+0000 7f327d057640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 0x7f325c09b830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32740098b0 tx=0x7f3274008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.084+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3270016500 con 0x7f32781454b0 2024-04-26T00:50:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.252+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f327806db70 con 0x7f32781454b0 2024-04-26T00:50:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.672+0000 7f326dffb640 1 -- 172.21.15.6:0/2566341891 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f327012f200 con 0x7f32781454b0 2024-04-26T00:50:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2024-04-26T00:50:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 10 mgrc shutdown 2024-04-26T00:50:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 msgr2=0x7f325c09b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 0x7f325c09b830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32740098b0 tx=0x7f3274008040 comp rx=0 tx=0).stop 2024-04-26T00:50:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 msgr2=0x7f3278143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32700b0040 tx=0x7f3270019620 comp rx=0 tx=0).stop 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 shutdown_connections 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f325c099370 0x7f325c09b830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781454b0 0x7f3278143330 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f327814b620 0x7f327809e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 --2- 172.21.15.6:0/2566341891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32780a5a90 0x7f32781443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 >> 172.21.15.6:0/2566341891 conn(0x7f327806e7b0 msgr2=0x7f327806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 shutdown_connections 2024-04-26T00:50:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.676+0000 7f327f2bb640 1 -- 172.21.15.6:0/2566341891 wait complete. 2024-04-26T00:50:33.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T00:50:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 Processor -- start 2024-04-26T00:50:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 -- start start 2024-04-26T00:50:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0f4413af20 0x7f0f440a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f440aaec0 con 0x7f0f440a6aa0 2024-04-26T00:50:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f441486d0 con 0x7f0f440a9810 2024-04-26T00:50:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4b8df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0f44148990 con 0x7f0f4413af20 2024-04-26T00:50:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4967b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0f440a6aa0 0x7f0f440aa7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56934/0 (socket says 172.21.15.6:56934) 2024-04-26T00:50:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f4967b640 1 -- 172.21.15.6:0/1635278088 learned_addr learned my addr 172.21.15.6:0/1635278088 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.820+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/1635278088 >> v2:172.21.15.188:3300/0 conn(0x7f0f4413af20 0x7f0f440a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568094145 0 0) 0x7f0f34001120 con 0x7f0f440a6aa0 2024-04-26T00:50:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c003530 con 0x7f0f440a6aa0 2024-04-26T00:50:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3287902672 0 0) 0x7f0f2c003530 con 0x7f0f440a6aa0 2024-04-26T00:50:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 >> v2:172.21.15.188:3300/0 conn(0x7f0f4413af20 msgr2=0x7f0f440a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 --2- 172.21.15.6:0/1635278088 >> v2:172.21.15.188:3300/0 conn(0x7f0f4413af20 0x7f0f440a92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 >> v1:172.21.15.188:6789/0 conn(0x7f0f440a9810 legacy=0x7f0f4414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4406b790 con 0x7f0f440a6aa0 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f0f34001850 con 0x7f0f440a6aa0 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 >> v1:172.21.15.6:6789/0 conn(0x7f0f440a6aa0 legacy=0x7f0f440aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c003a30 0x7f0f2c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 0x7f0f2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f2c005240 0x7f0f2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44148990 con 0x7f0f2c004810 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c00c1a0 con 0x7f0f2c003a30 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2c00c3a0 con 0x7f0f2c005240 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 0x7f0f2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f49e7c640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f2c005240 0x7f0f2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f4967b640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c003a30 0x7f0f2c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 -- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f2c005240 msgr2=0x7f0f2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f2c005240 0x7f0f2c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 -- 172.21.15.6:0/1635278088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c003a30 msgr2=0x7f0f2c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c003a30 0x7f0f2c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 -- 172.21.15.6:0/1635278088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c003530 con 0x7f0f2c004810 2024-04-26T00:50:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f49e7c640 1 -- 172.21.15.6:0/1635278088 reap_dead start 2024-04-26T00:50:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 0x7f0f2c004c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009ae0 tx=0x7f0f3801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed39f6ecbc202b55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380b2070 con 0x7f0f2c004810 2024-04-26T00:50:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f380a5550 con 0x7f0f2c004810 2024-04-26T00:50:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.824+0000 7f0f43fff640 1 -- 172.21.15.6:0/1635278088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380096b0 con 0x7f0f2c004810 2024-04-26T00:50:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 msgr2=0x7f0f2c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 0x7f0f2c004c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009ae0 tx=0x7f0f3801ca70 comp rx=0 tx=0).stop 2024-04-26T00:50:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/1635278088 shutdown_connections 2024-04-26T00:50:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/1635278088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f2c004810 0x7f0f2c004c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/1635278088 >> 172.21.15.6:0/1635278088 conn(0x7f0f440707c0 msgr2=0x7f0f440b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/1635278088 shutdown_connections 2024-04-26T00:50:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/1635278088 wait complete. 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 Processor -- start 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- start start 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 0x7f0f440b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 0x7f0f441ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440aab40 con 0x7f0f440b18f0 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440aa9c0 con 0x7f0f2c004810 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0f440aacc0 con 0x7f0f440a4060 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f48e7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 0x7f0f441ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:46998/0 (socket says 172.21.15.6:46998) 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 -- 172.21.15.6:0/633297091 learned_addr learned my addr 172.21.15.6:0/633297091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4967b640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 0x7f0f440b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 -- 172.21.15.6:0/633297091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 msgr2=0x7f0f440b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 0x7f0f440b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 -- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 msgr2=0x7f0f441ddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 0x7f0f441ddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 -- 172.21.15.6:0/633297091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f441de9b0 con 0x7f0f440a4060 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4967b640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 0x7f0f440b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f48e7a640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 0x7f0f441ddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f49e7c640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f44070250 tx=0x7f0f3c00fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c003b90 con 0x7f0f440a4060 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c018070 con 0x7f0f440a4060 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f441dec70 con 0x7f0f440a4060 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0050d0 con 0x7f0f440a4060 2024-04-26T00:50:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.828+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f440b0c30 con 0x7f0f440a4060 2024-04-26T00:50:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4406db70 con 0x7f0f440a4060 2024-04-26T00:50:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f0f3c005270 con 0x7f0f440a4060 2024-04-26T00:50:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 0x7f0f3009b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f4967b640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 0x7f0f3009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f0f3c0c2920 con 0x7f0f440a4060 2024-04-26T00:50:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.832+0000 7f0f4967b640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 0x7f0f3009b800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f34001ec0 tx=0x7f0f34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:33.836+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0f3c093b70 con 0x7f0f440a4060 2024-04-26T00:50:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.004+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f0f4406c230 con 0x7f0f440a4060 2024-04-26T00:50:34.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.684+0000 7f0f41ffb640 1 -- 172.21.15.6:0/633297091 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 173+0+0 (secure 0 0 0) 0x7f0f3c093470 con 0x7f0f440a4060 2024-04-26T00:50:34.692 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T00:50:34.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.688+0000 7f0f4b8df640 10 mgrc shutdown 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.688+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 msgr2=0x7f0f3009b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.688+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 0x7f0f3009b800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f34001ec0 tx=0x7f0f34009040 comp rx=0 tx=0).stop 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.688+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 msgr2=0x7f0f441de260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.688+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f44070250 tx=0x7f0f3c00fd40 comp rx=0 tx=0).stop 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 shutdown_connections 2024-04-26T00:50:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0f30099340 0x7f0f3009b800 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f440a4060 0x7f0f441de260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440b18f0 0x7f0f441ddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 --2- 172.21.15.6:0/633297091 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f2c004810 0x7f0f440b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 >> 172.21.15.6:0/633297091 conn(0x7f0f440707c0 msgr2=0x7f0f44137ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 shutdown_connections 2024-04-26T00:50:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.692+0000 7f0f4b8df640 1 -- 172.21.15.6:0/633297091 wait complete. 2024-04-26T00:50:34.720 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T00:50:34.721 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T00:50:34.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T00:50:34.723 INFO:tasks.ceph.mds.a:Started 2024-04-26T00:50:34.723 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T00:50:34.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T00:50:34.725 INFO:tasks.ceph.mds.c:Started 2024-04-26T00:50:34.725 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T00:50:34.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T00:50:34.728 INFO:tasks.ceph.mds.b:Started 2024-04-26T00:50:34.728 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T00:50:34.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:34.800 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-04-26T00:50:34.801 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-04-26T00:50:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 Processor -- start 2024-04-26T00:50:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 -- start start 2024-04-26T00:50:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd034142510 0x7fd0340b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd034073090 0x7fd03414d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340723e0 con 0x7fd0340717c0 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd034146410 con 0x7fd034073090 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd03963c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd0341466d0 con 0x7fd034142510 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd0337fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd034073090 0x7fd03414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd0327fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd0340717c0 0x7fd034071cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56952/0 (socket says 172.21.15.6:56952) 2024-04-26T00:50:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd0327fc640 1 -- 172.21.15.6:0/3793025855 learned_addr learned my addr 172.21.15.6:0/3793025855 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.836+0000 7fd032ffd640 1 --2- 172.21.15.6:0/3793025855 >> v2:172.21.15.188:3300/0 conn(0x7fd034142510 0x7fd0340b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd0337fe640 1 -- 172.21.15.6:0/3793025855 >> v2:172.21.15.188:3300/0 conn(0x7fd034142510 msgr2=0x7fd0340b8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd0337fe640 1 --2- 172.21.15.6:0/3793025855 >> v2:172.21.15.188:3300/0 conn(0x7fd034142510 0x7fd0340b8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd0337fe640 1 -- 172.21.15.6:0/3793025855 >> v1:172.21.15.6:6789/0 conn(0x7fd0340717c0 legacy=0x7fd034071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd0337fe640 1 -- 172.21.15.6:0/3793025855 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340b9030 con 0x7fd034073090 2024-04-26T00:50:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd0337fe640 1 --2- 172.21.15.6:0/3793025855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd034073090 0x7fd03414d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd0340aaa60 tx=0x7fd02c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2776bef92c37592 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd031ffb640 1 -- 172.21.15.6:0/3793025855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c0b2070 con 0x7fd034073090 2024-04-26T00:50:34.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd031ffb640 1 -- 172.21.15.6:0/3793025855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c0a5960 con 0x7fd034073090 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd031ffb640 1 -- 172.21.15.6:0/3793025855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c0a5d30 con 0x7fd034073090 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- 172.21.15.6:0/3793025855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd034073090 msgr2=0x7fd03414d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 --2- 172.21.15.6:0/3793025855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd034073090 0x7fd03414d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd0340aaa60 tx=0x7fd02c01c880 comp rx=0 tx=0).stop 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- 172.21.15.6:0/3793025855 shutdown_connections 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 --2- 172.21.15.6:0/3793025855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd034073090 0x7fd03414d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 --2- 172.21.15.6:0/3793025855 >> v2:172.21.15.188:3300/0 conn(0x7fd034142510 0x7fd0340b8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- 172.21.15.6:0/3793025855 >> 172.21.15.6:0/3793025855 conn(0x7fd03406cc00 msgr2=0x7fd034070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- 172.21.15.6:0/3793025855 shutdown_connections 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- 172.21.15.6:0/3793025855 wait complete. 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 Processor -- start 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.840+0000 7fd03963c640 1 -- start start 2024-04-26T00:50:34.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 0x7fd0340a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 0x7fd0341488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd034150660 con 0x7fd0340717c0 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341504e0 con 0x7fd034073090 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd0341507e0 con 0x7fd034142510 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49830/0 (socket says 172.21.15.6:49830) 2024-04-26T00:50:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 -- 172.21.15.6:0/1610947191 learned_addr learned my addr 172.21.15.6:0/1610947191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd0337fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 0x7fd0341488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd0327fc640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 0x7fd0340a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 -- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 msgr2=0x7fd0341488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 0x7fd0341488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 -- 172.21.15.6:0/1610947191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 msgr2=0x7fd0340a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 0x7fd0340a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 -- 172.21.15.6:0/1610947191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340a0ce0 con 0x7fd0340717c0 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd0337fe640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 0x7fd0341488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd0327fc640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 0x7fd0340a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:34.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd032ffd640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd02400d860 tx=0x7fd02400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02400de50 con 0x7fd0340717c0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024019070 con 0x7fd0340717c0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02400bad0 con 0x7fd0340717c0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0340b69d0 con 0x7fd0340717c0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0340a08f0 con 0x7fd0340717c0 2024-04-26T00:50:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.844+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03406db70 con 0x7fd0340717c0 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd02400bc70 con 0x7fd0340717c0 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 0x7fd02009b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:34.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd0327fc640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 0x7fd02009b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:34.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fd0240c2e70 con 0x7fd0340717c0 2024-04-26T00:50:34.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.848+0000 7fd0327fc640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 0x7fd02009b8e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd034071330 tx=0x7fd028009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:34.852+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd0240940b0 con 0x7fd0340717c0 2024-04-26T00:50:34.880 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-04-26T00:50:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.012+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0340b83a0 con 0x7fd0340717c0 2024-04-26T00:50:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.012+0000 7fd01b7fe640 1 -- 172.21.15.6:0/1610947191 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9731 (secure 0 0 0) 0x7fd0240b20d0 con 0x7fd0340717c0 2024-04-26T00:50:35.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:35.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":15,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:34.678288+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:35.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 10 mgrc shutdown 2024-04-26T00:50:35.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 msgr2=0x7fd02009b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 0x7fd02009b8e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd034071330 tx=0x7fd028009040 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 msgr2=0x7fd03414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd02400d860 tx=0x7fd02400dd20 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 shutdown_connections 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd020099420 0x7fd02009b8e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd034142510 0x7fd0341488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd034073090 0x7fd0340a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 --2- 172.21.15.6:0/1610947191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0340717c0 0x7fd03414a230 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 >> 172.21.15.6:0/1610947191 conn(0x7fd03406cc00 msgr2=0x7fd03406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 shutdown_connections 2024-04-26T00:50:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.016+0000 7fd03963c640 1 -- 172.21.15.6:0/1610947191 wait complete. 2024-04-26T00:50:35.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T00:50:28.326359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T00:50:33.296137+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T00:50:35.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T00:50:35.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.148+0000 7fa5f1ba2640 1 Processor -- start 2024-04-26T00:50:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.148+0000 7fa5f1ba2640 1 -- start start 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 0x7fa5ec14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5ec135380 con 0x7fa5ec0735d0 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa5ec0716a0 con 0x7fa5ec139360 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ec071e80 con 0x7fa5ec0a7880 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47024/0 (socket says 172.21.15.6:47024) 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 -- 172.21.15.6:0/1617427980 learned_addr learned my addr 172.21.15.6:0/1617427980 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 -- 172.21.15.6:0/1617427980 >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 msgr2=0x7fa5ec14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5ebfff640 1 --2- 172.21.15.6:0/1617427980 >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 0x7fa5ec14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 --2- 172.21.15.6:0/1617427980 >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 0x7fa5ec14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 -- 172.21.15.6:0/1617427980 >> v1:172.21.15.188:6789/0 conn(0x7fa5ec0735d0 legacy=0x7fa5ec135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 -- 172.21.15.6:0/1617427980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec0a7c60 con 0x7fa5ec0a7880 2024-04-26T00:50:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5ebfff640 1 --2- 172.21.15.6:0/1617427980 >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 0x7fa5ec14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eb7fe640 1 --2- 172.21.15.6:0/1617427980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a9720 tx=0x7fa5dc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1183b0897392ccd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eaffd640 1 -- 172.21.15.6:0/1617427980 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0ab640 con 0x7fa5ec0a7880 2024-04-26T00:50:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eaffd640 1 -- 172.21.15.6:0/1617427980 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0b0070 con 0x7fa5ec0a7880 2024-04-26T00:50:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5eaffd640 1 -- 172.21.15.6:0/1617427980 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0aba00 con 0x7fa5ec0a7880 2024-04-26T00:50:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1617427980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 msgr2=0x7fa5ec072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1617427980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a9720 tx=0x7fa5dc01c4c0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1617427980 shutdown_connections 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1617427980 >> v2:172.21.15.188:3300/0 conn(0x7fa5ec139360 0x7fa5ec14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1617427980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec072380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1617427980 >> 172.21.15.6:0/1617427980 conn(0x7fa5ec0702f0 msgr2=0x7fa5ec0706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1617427980 shutdown_connections 2024-04-26T00:50:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.152+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1617427980 wait complete. 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 Processor -- start 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- start start 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec0735d0 0x7fa5ec09e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec150520 con 0x7fa5ec139360 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec072980 con 0x7fa5ec0735d0 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ec1506a0 con 0x7fa5ec0a7880 2024-04-26T00:50:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e3fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49844/0 (socket says 172.21.15.6:49844) 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e3fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47026/0 (socket says 172.21.15.6:47026) 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 -- 172.21.15.6:0/1478211335 learned_addr learned my addr 172.21.15.6:0/1478211335 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5eb7fe640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec0735d0 0x7fa5ec09e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 -- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 msgr2=0x7fa5ec0a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 -- 172.21.15.6:0/1478211335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec0735d0 msgr2=0x7fa5ec09e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec0735d0 0x7fa5ec09e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 -- 172.21.15.6:0/1478211335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec0a14e0 con 0x7fa5ec139360 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e3fff640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5ebfff640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400ccf0 tx=0x7fa5e400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400f680 con 0x7fa5ec139360 2024-04-26T00:50:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e400f840 con 0x7fa5ec139360 2024-04-26T00:50:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400fc30 con 0x7fa5ec139360 2024-04-26T00:50:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec0a17a0 con 0x7fa5ec139360 2024-04-26T00:50:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec0a1180 con 0x7fa5ec139360 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.156+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ec06db70 con 0x7fa5ec139360 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fa5e400e3e0 con 0x7fa5ec139360 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 0x7fa5cc09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5eb7fe640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 0x7fa5cc09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fa5e40c2e20 con 0x7fa5ec139360 2024-04-26T00:50:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.160+0000 7fa5eb7fe640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 0x7fa5cc09b800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a9720 tx=0x7fa5dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.164+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa5e4014030 con 0x7fa5ec139360 2024-04-26T00:50:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5ec0aad80 con 0x7fa5ec139360 2024-04-26T00:50:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5e8ff9640 1 -- 172.21.15.6:0/1478211335 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) ==== 93+0+10 (secure 0 0 0) 0x7fa5e4094100 con 0x7fa5ec139360 2024-04-26T00:50:35.336 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 10 mgrc shutdown 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 msgr2=0x7fa5cc09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 0x7fa5cc09b800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0a9720 tx=0x7fa5dc008040 comp rx=0 tx=0).stop 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 msgr2=0x7fa5ec0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400ccf0 tx=0x7fa5e400a650 comp rx=0 tx=0).stop 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 shutdown_connections 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fa5cc099340 0x7fa5cc09b800 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec139360 0x7fa5ec0a34e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5ec0a7880 0x7fa5ec0a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 --2- 172.21.15.6:0/1478211335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec0735d0 0x7fa5ec09e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.328+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 >> 172.21.15.6:0/1478211335 conn(0x7fa5ec0702f0 msgr2=0x7fa5ec0a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.332+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 shutdown_connections 2024-04-26T00:50:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.332+0000 7fa5f1ba2640 1 -- 172.21.15.6:0/1478211335 wait complete. 2024-04-26T00:50:35.356 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T00:50:35.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 Processor -- start 2024-04-26T00:50:35.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 -- start start 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facec073510 0x7facec14c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec071250 con 0x7facec0b73d0 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7facec0b77b0 con 0x7facec073510 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facf09f8640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7facec0a5e50 con 0x7facec138330 2024-04-26T00:50:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facead9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facec073510 0x7facec14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47038/0 (socket says 172.21.15.6:47038) 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 -- 172.21.15.6:0/2865566576 learned_addr learned my addr 172.21.15.6:0/2865566576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 -- 172.21.15.6:0/2865566576 >> v2:172.21.15.6:3300/0 conn(0x7facec073510 msgr2=0x7facec14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 --2- 172.21.15.6:0/2865566576 >> v2:172.21.15.6:3300/0 conn(0x7facec073510 0x7facec14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 -- 172.21.15.6:0/2865566576 >> v1:172.21.15.188:6789/0 conn(0x7facec0b73d0 legacy=0x7facec134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7face9d9b640 1 -- 172.21.15.6:0/2865566576 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec06fc10 con 0x7facec138330 2024-04-26T00:50:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.476+0000 7facead9d640 1 --2- 172.21.15.6:0/2865566576 >> v2:172.21.15.6:3300/0 conn(0x7facec073510 0x7facec14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face9d9b640 1 --2- 172.21.15.6:0/2865566576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7face0009870 tx=0x7face001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa514699f2d9a89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face959a640 1 -- 172.21.15.6:0/2865566576 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00ab660 con 0x7facec138330 2024-04-26T00:50:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face959a640 1 -- 172.21.15.6:0/2865566576 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face00b0070 con 0x7facec138330 2024-04-26T00:50:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face959a640 1 -- 172.21.15.6:0/2865566576 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00aba20 con 0x7facec138330 2024-04-26T00:50:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/2865566576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 msgr2=0x7facec072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- 172.21.15.6:0/2865566576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7face0009870 tx=0x7face001c500 comp rx=0 tx=0).stop 2024-04-26T00:50:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/2865566576 shutdown_connections 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- 172.21.15.6:0/2865566576 >> v2:172.21.15.6:3300/0 conn(0x7facec073510 0x7facec14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- 172.21.15.6:0/2865566576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec138330 0x7facec072640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/2865566576 >> 172.21.15.6:0/2865566576 conn(0x7facec06e7b0 msgr2=0x7facec0b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/2865566576 shutdown_connections 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/2865566576 wait complete. 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 Processor -- start 2024-04-26T00:50:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- start start 2024-04-26T00:50:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 0x7facec14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 0x7facec1de220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7facec071880 con 0x7facec138330 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facec071700 con 0x7facec0b73d0 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7facec0a64d0 con 0x7facec073510 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facead9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 0x7facec1de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47044/0 (socket says 172.21.15.6:47044) 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 -- 172.21.15.6:0/898909875 learned_addr learned my addr 172.21.15.6:0/898909875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face9d9b640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 0x7facec14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 -- 172.21.15.6:0/898909875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 msgr2=0x7facec14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 0x7facec14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 -- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 msgr2=0x7facec1de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 0x7facec1de220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 -- 172.21.15.6:0/898909875 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec14b900 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facead9d640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 0x7facec1de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7face9d9b640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 0x7facec14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facea59c640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c450 tx=0x7facdc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc011790 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facdc017070 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec14bbc0 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc011b90 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.480+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facec14b420 con 0x7facec073510 2024-04-26T00:50:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec06db70 con 0x7facec073510 2024-04-26T00:50:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7facdc011d30 con 0x7facec073510 2024-04-26T00:50:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 0x7faccc09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7face9d9b640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 0x7faccc09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7facdc0c1e80 con 0x7facec073510 2024-04-26T00:50:35.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.484+0000 7face9d9b640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 0x7faccc09b800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7face00af000 tx=0x7face00a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.488+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7facdc093160 con 0x7facec073510 2024-04-26T00:50:35.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.652+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7facec14fb00 con 0x7facec073510 2024-04-26T00:50:35.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.652+0000 7facdaffd640 1 -- 172.21.15.6:0/898909875 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) ==== 92+0+10 (secure 0 0 0) 0x7facdc092a60 con 0x7facec073510 2024-04-26T00:50:35.661 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2024-04-26T00:50:35.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 10 mgrc shutdown 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 msgr2=0x7faccc09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 0x7faccc09b800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7face00af000 tx=0x7face00a7000 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 msgr2=0x7facec09f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c450 tx=0x7facdc00c850 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 shutdown_connections 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7faccc099340 0x7faccc09b800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facec138330 0x7facec1de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facec0b73d0 0x7facec14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 --2- 172.21.15.6:0/898909875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facec073510 0x7facec09f1e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 >> 172.21.15.6:0/898909875 conn(0x7facec06e7b0 msgr2=0x7facec0a7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 shutdown_connections 2024-04-26T00:50:35.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.656+0000 7facf09f8640 1 -- 172.21.15.6:0/898909875 wait complete. 2024-04-26T00:50:35.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:50:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 Processor -- start 2024-04-26T00:50:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 -- start start 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd8b80b4390 0x7fd8b80aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8b814b820 0x7fd8b814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80aabe0 con 0x7fd8b81464a0 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b80b4770 con 0x7fd8b814b820 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8bc941640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b8072830 con 0x7fd8b80b4390 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8b814b820 0x7fd8b814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8affff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8b81464a0 0x7fd8b8072120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56956/0 (socket says 172.21.15.6:56956) 2024-04-26T00:50:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8affff640 1 -- 172.21.15.6:0/263416915 learned_addr learned my addr 172.21.15.6:0/263416915 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 -- 172.21.15.6:0/263416915 >> v2:172.21.15.188:3300/0 conn(0x7fd8b80b4390 msgr2=0x7fd8b80aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 --2- 172.21.15.6:0/263416915 >> v2:172.21.15.188:3300/0 conn(0x7fd8b80b4390 0x7fd8b80aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 -- 172.21.15.6:0/263416915 >> v1:172.21.15.6:6789/0 conn(0x7fd8b81464a0 legacy=0x7fd8b8072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b5d9b640 1 -- 172.21.15.6:0/263416915 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880796904 0 0) 0x7fd8b80aabe0 con 0x7fd8b81464a0 2024-04-26T00:50:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 -- 172.21.15.6:0/263416915 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b8146a00 con 0x7fd8b814b820 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b6d9d640 1 --2- 172.21.15.6:0/263416915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b814b820 0x7fd8b814dc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80a7da0 tx=0x7fd8b001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a104c53e7c52b1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b5d9b640 1 -- 172.21.15.6:0/263416915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00b2070 con 0x7fd8b814b820 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b5d9b640 1 -- 172.21.15.6:0/263416915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b00a5940 con 0x7fd8b814b820 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.796+0000 7fd8b5d9b640 1 -- 172.21.15.6:0/263416915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00a5d10 con 0x7fd8b814b820 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- 172.21.15.6:0/263416915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b814b820 msgr2=0x7fd8b814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- 172.21.15.6:0/263416915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b814b820 0x7fd8b814dc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80a7da0 tx=0x7fd8b001c880 comp rx=0 tx=0).stop 2024-04-26T00:50:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- 172.21.15.6:0/263416915 shutdown_connections 2024-04-26T00:50:35.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- 172.21.15.6:0/263416915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b814b820 0x7fd8b814dc10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- 172.21.15.6:0/263416915 >> v2:172.21.15.188:3300/0 conn(0x7fd8b80b4390 0x7fd8b80aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- 172.21.15.6:0/263416915 >> 172.21.15.6:0/263416915 conn(0x7fd8b806e230 msgr2=0x7fd8b80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- 172.21.15.6:0/263416915 shutdown_connections 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- 172.21.15.6:0/263416915 wait complete. 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 Processor -- start 2024-04-26T00:50:35.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- start start 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 0x7fd8b80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b814b820 0x7fd8b80b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b80b7730 con 0x7fd8b81464a0 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b80734e0 con 0x7fd8b814b820 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8bc941640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b8150970 con 0x7fd8b80b4390 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47048/0 (socket says 172.21.15.6:47048) 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 0x7fd8b80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 -- 172.21.15.6:0/374932097 learned_addr learned my addr 172.21.15.6:0/374932097 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:35.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b6d9d640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b814b820 0x7fd8b80b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 -- 172.21.15.6:0/374932097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b814b820 msgr2=0x7fd8b80b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b814b820 0x7fd8b80b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 -- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 msgr2=0x7fd8b80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 0x7fd8b80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 -- 172.21.15.6:0/374932097 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b81db340 con 0x7fd8b80b4390 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8affff640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 0x7fd8b80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:35.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.800+0000 7fd8b659c640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800b550 tx=0x7fd8a800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8014070 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b813d240 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b813d570 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a8010610 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a801e060 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.804+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c005090 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd8a8017070 con 0x7fd8b80b4390 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 0x7fd89809b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8affff640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 0x7fd89809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fd8a80c2000 con 0x7fd8b80b4390 2024-04-26T00:50:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.808+0000 7fd8affff640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 0x7fd89809b780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b806baf0 tx=0x7fd8a0007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:35.812+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd8a80932e0 con 0x7fd8b80b4390 2024-04-26T00:50:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.004+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd89c005650 con 0x7fd8b80b4390 2024-04-26T00:50:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.004+0000 7fd8aeffd640 1 -- 172.21.15.6:0/374932097 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3037 (secure 0 0 0) 0x7fd8a8092be0 con 0x7fd8b80b4390 2024-04-26T00:50:36.065 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:36.065 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 10 mgrc shutdown 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 msgr2=0x7fd89809b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 0x7fd89809b780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b806baf0 tx=0x7fd8a0007d60 comp rx=0 tx=0).stop 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 msgr2=0x7fd8b813baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800b550 tx=0x7fd8a800ba10 comp rx=0 tx=0).stop 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 shutdown_connections 2024-04-26T00:50:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8980992c0 0x7fd89809b780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b814b820 0x7fd8b80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b81464a0 0x7fd8b80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 --2- 172.21.15.6:0/374932097 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8b80b4390 0x7fd8b813baf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 >> 172.21.15.6:0/374932097 conn(0x7fd8b806e230 msgr2=0x7fd8b80a6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 shutdown_connections 2024-04-26T00:50:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.008+0000 7fd8bc941640 1 -- 172.21.15.6:0/374932097 wait complete. 2024-04-26T00:50:36.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.168+0000 7f6b471b0640 1 Processor -- start 2024-04-26T00:50:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.168+0000 7f6b471b0640 1 -- start start 2024-04-26T00:50:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4006f0e0 con 0x7f6b400729c0 2024-04-26T00:50:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4006f6e0 con 0x7f6b40137ca0 2024-04-26T00:50:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4006f9a0 con 0x7f6b400a7b30 2024-04-26T00:50:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b4574d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6b400729c0 0x7f6b40070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56964/0 (socket says 172.21.15.6:56964) 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47064/0 (socket says 172.21.15.6:47064) 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b4574d640 1 -- 172.21.15.6:0/1498188108 learned_addr learned my addr 172.21.15.6:0/1498188108 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b3f7fe640 1 -- 172.21.15.6:0/1498188108 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100589643 0 0) 0x7f6b4006f0e0 con 0x7f6b400729c0 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 -- 172.21.15.6:0/1498188108 >> v1:172.21.15.188:6789/0 conn(0x7f6b40137ca0 legacy=0x7f6b40071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 -- 172.21.15.6:0/1498188108 >> v1:172.21.15.6:6789/0 conn(0x7f6b400729c0 legacy=0x7f6b40070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 -- 172.21.15.6:0/1498188108 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4006fc60 con 0x7f6b400a7b30 2024-04-26T00:50:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b44f4c640 1 --2- 172.21.15.6:0/1498188108 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000a990 tx=0x7f6b3001d730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b646af2bdc14eee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b3f7fe640 1 -- 172.21.15.6:0/1498188108 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b300b3070 con 0x7f6b400a7b30 2024-04-26T00:50:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b3f7fe640 1 -- 172.21.15.6:0/1498188108 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b300a67a0 con 0x7f6b400a7b30 2024-04-26T00:50:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b3f7fe640 1 -- 172.21.15.6:0/1498188108 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000b040 con 0x7f6b400a7b30 2024-04-26T00:50:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- 172.21.15.6:0/1498188108 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 msgr2=0x7f6b400a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1498188108 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000a990 tx=0x7f6b3001d730 comp rx=0 tx=0).stop 2024-04-26T00:50:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- 172.21.15.6:0/1498188108 shutdown_connections 2024-04-26T00:50:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1498188108 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b400a7b30 0x7f6b400a7f10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- 172.21.15.6:0/1498188108 >> 172.21.15.6:0/1498188108 conn(0x7f6b4006e230 msgr2=0x7f6b400b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- 172.21.15.6:0/1498188108 shutdown_connections 2024-04-26T00:50:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.172+0000 7f6b471b0640 1 -- 172.21.15.6:0/1498188108 wait complete. 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 Processor -- start 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- start start 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b400729c0 0x7f6b4009f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 0x7f6b40144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4014fa70 con 0x7f6b400a7b30 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4014f8f0 con 0x7f6b400729c0 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4014fbf0 con 0x7f6b40137ca0 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b4574d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 0x7f6b40144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b4574d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:47068/0 (socket says 172.21.15.6:47068) 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b4574d640 1 -- 172.21.15.6:0/1021413512 learned_addr learned my addr 172.21.15.6:0/1021413512 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 -- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 msgr2=0x7f6b400b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 -- 172.21.15.6:0/1021413512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b400729c0 msgr2=0x7f6b4009f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b400729c0 0x7f6b4009f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 -- 172.21.15.6:0/1021413512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b401481b0 con 0x7f6b400a7b30 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b4574d640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3ffff640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 0x7f6b40144770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c3e0 tx=0x7f6b3400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34017070 con 0x7f6b400a7b30 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b34003600 con 0x7f6b400a7b30 2024-04-26T00:50:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4014cb90 con 0x7f6b400a7b30 2024-04-26T00:50:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340039d0 con 0x7f6b400a7b30 2024-04-26T00:50:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40145c70 con 0x7f6b400a7b30 2024-04-26T00:50:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.176+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4006db70 con 0x7f6b400a7b30 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f6b3401a070 con 0x7f6b400a7b30 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 0x7f6b2c09b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b44f4c640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 0x7f6b2c09b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f6b340c1a80 con 0x7f6b400a7b30 2024-04-26T00:50:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b44f4c640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 0x7f6b2c09b830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b300b0000 tx=0x7f6b30004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.180+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6b34092710 con 0x7f6b400a7b30 2024-04-26T00:50:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.340+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b4006f340 con 0x7f6b400a7b30 2024-04-26T00:50:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.340+0000 7f6b3d7fa640 1 -- 172.21.15.6:0/1021413512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9718 (secure 0 0 0) 0x7f6b34096a10 con 0x7f6b400a7b30 2024-04-26T00:50:36.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:36.350 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:35.690967+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 10 mgrc shutdown 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 msgr2=0x7f6b2c09b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 0x7f6b2c09b830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b300b0000 tx=0x7f6b30004740 comp rx=0 tx=0).stop 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 msgr2=0x7f6b40144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 0x7f6b40144770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c3e0 tx=0x7f6b3400c8a0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 shutdown_connections 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f6b2c099370 0x7f6b2c09b830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b40137ca0 0x7f6b400b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b400a7b30 0x7f6b40144770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 --2- 172.21.15.6:0/1021413512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b400729c0 0x7f6b4009f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 >> 172.21.15.6:0/1021413512 conn(0x7f6b4006e230 msgr2=0x7f6b400b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 shutdown_connections 2024-04-26T00:50:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.344+0000 7f6b471b0640 1 -- 172.21.15.6:0/1021413512 wait complete. 2024-04-26T00:50:36.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T00:50:28.326359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T00:50:33.296137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T00:50:36.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T00:50:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 Processor -- start 2024-04-26T00:50:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 -- start start 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed40aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ed4072910 0x7f8ed40b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed40a8120 con 0x7f8ed40a64d0 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8ed4071310 con 0x7f8ed4072910 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed9255640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed4072fc0 con 0x7f8ed40a5a90 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ed4072910 0x7f8ed40b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed40aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ed4072910 0x7f8ed40b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38102/0 (socket says 172.21.15.6:38102) 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 -- 172.21.15.6:0/3303802973 learned_addr learned my addr 172.21.15.6:0/3303802973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 -- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 msgr2=0x7f8ed40aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 --2- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed40aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 -- 172.21.15.6:0/3303802973 >> v1:172.21.15.188:6789/0 conn(0x7f8ed40a64d0 legacy=0x7f8ed40a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.484+0000 7f8ed259c640 1 -- 172.21.15.6:0/3303802973 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed40aaa90 con 0x7f8ed4072910 2024-04-26T00:50:36.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed259c640 1 --2- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4072910 0x7f8ed40b7170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009e50 tx=0x7f8ebc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2c612e5090a988 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed1d9b640 1 -- 172.21.15.6:0/3303802973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0a5760 con 0x7f8ed4072910 2024-04-26T00:50:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed1d9b640 1 -- 172.21.15.6:0/3303802973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc0a5900 con 0x7f8ed4072910 2024-04-26T00:50:36.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed1d9b640 1 -- 172.21.15.6:0/3303802973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0a5cd0 con 0x7f8ed4072910 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4072910 msgr2=0x7f8ed40b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4072910 0x7f8ed40b7170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009e50 tx=0x7f8ebc01c9d0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3303802973 shutdown_connections 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4072910 0x7f8ed40b7170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3303802973 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed40aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3303802973 >> 172.21.15.6:0/3303802973 conn(0x7f8ed406e7b0 msgr2=0x7f8ed40b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3303802973 shutdown_connections 2024-04-26T00:50:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3303802973 wait complete. 2024-04-26T00:50:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 Processor -- start 2024-04-26T00:50:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- start start 2024-04-26T00:50:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed40a64d0 0x7f8ed40aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 0x7f8ed40ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed40a5e70 con 0x7f8ed40a5500 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4073860 con 0x7f8ed40a64d0 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed40a5ff0 con 0x7f8ed40a5a90 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 0x7f8ed40ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38804/0 (socket says 172.21.15.6:38804) 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 -- 172.21.15.6:0/3754343773 learned_addr learned my addr 172.21.15.6:0/3754343773 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 -- 172.21.15.6:0/3754343773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed40a64d0 msgr2=0x7f8ed40aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed259c640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed40a64d0 0x7f8ed40aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed40a64d0 0x7f8ed40aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 -- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 msgr2=0x7f8ed40ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 0x7f8ed40ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 -- 172.21.15.6:0/3754343773 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed414b630 con 0x7f8ed40a5a90 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed359e640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 0x7f8ed40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed2d9d640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e990 tx=0x7f8ec400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4017070 con 0x7f8ed40a5a90 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec400c980 con 0x7f8ed40a5a90 2024-04-26T00:50:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed414b8d0 con 0x7f8ed40a5a90 2024-04-26T00:50:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400cd30 con 0x7f8ed40a5a90 2024-04-26T00:50:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.488+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed40ad590 con 0x7f8ed40a5a90 2024-04-26T00:50:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed406db70 con 0x7f8ed40a5a90 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f8ec401a070 con 0x7f8ed40a5a90 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 0x7f8eb409b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f8ec40c27d0 con 0x7f8ed40a5a90 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ed259c640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 0x7f8eb409b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.492+0000 7f8ed259c640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 0x7f8eb409b830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0ae000 tx=0x7f8ebc0a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.496+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8ec4093a10 con 0x7f8ed40a5a90 2024-04-26T00:50:36.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.652+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ed40b6e20 con 0x7f8ed40a5a90 2024-04-26T00:50:36.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.652+0000 7f8ecb7fe640 1 -- 172.21.15.6:0/3754343773 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f8ec4093310 con 0x7f8ed40a5a90 2024-04-26T00:50:36.661 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 10 mgrc shutdown 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 msgr2=0x7f8eb409b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 0x7f8eb409b830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0ae000 tx=0x7f8ebc0a7070 comp rx=0 tx=0).stop 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 msgr2=0x7f8ed414dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e990 tx=0x7f8ec400ee50 comp rx=0 tx=0).stop 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 shutdown_connections 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8eb4099370 0x7f8eb409b830 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed40a5500 0x7f8ed40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed40a64d0 0x7f8ed40aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 --2- 172.21.15.6:0/3754343773 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ed40a5a90 0x7f8ed414dc60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 >> 172.21.15.6:0/3754343773 conn(0x7f8ed406e7b0 msgr2=0x7f8ed40b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 shutdown_connections 2024-04-26T00:50:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.656+0000 7f8ed9255640 1 -- 172.21.15.6:0/3754343773 wait complete. 2024-04-26T00:50:36.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T00:50:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 Processor -- start 2024-04-26T00:50:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 -- start start 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9080a8120 con 0x7fd908072910 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd908071310 con 0x7fd90814b620 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90e6f5640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd908072fc0 con 0x7fd9080a5a90 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90cc92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38816/0 (socket says 172.21.15.6:38816) 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90cc92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38130/0 (socket says 172.21.15.6:38130) 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 -- 172.21.15.6:0/3129223738 learned_addr learned my addr 172.21.15.6:0/3129223738 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 -- 172.21.15.6:0/3129223738 >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 msgr2=0x7fd90814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 --2- 172.21.15.6:0/3129223738 >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 -- 172.21.15.6:0/3129223738 >> v1:172.21.15.6:6789/0 conn(0x7fd908072910 legacy=0x7fd9080b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd907fff640 1 -- 172.21.15.6:0/3129223738 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9080aaa90 con 0x7fd9080a5a90 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd90cc92640 1 --2- 172.21.15.6:0/3129223738 >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.800+0000 7fd906ffd640 1 -- 172.21.15.6:0/3129223738 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247042240 0 0) 0x7fd9080a8120 con 0x7fd908072910 2024-04-26T00:50:36.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 --2- 172.21.15.6:0/3129223738 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009870 tx=0x7fd8fc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b178e8082bba225 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd906ffd640 1 -- 172.21.15.6:0/3129223738 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0ab650 con 0x7fd9080a5a90 2024-04-26T00:50:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd906ffd640 1 -- 172.21.15.6:0/3129223738 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8fc0b0070 con 0x7fd9080a5a90 2024-04-26T00:50:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd906ffd640 1 -- 172.21.15.6:0/3129223738 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0aba10 con 0x7fd9080a5a90 2024-04-26T00:50:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- 172.21.15.6:0/3129223738 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 msgr2=0x7fd9080aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/3129223738 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009870 tx=0x7fd8fc01c540 comp rx=0 tx=0).stop 2024-04-26T00:50:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- 172.21.15.6:0/3129223738 shutdown_connections 2024-04-26T00:50:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/3129223738 >> v2:172.21.15.6:3300/0 conn(0x7fd90814b620 0x7fd90814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/3129223738 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080aa410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- 172.21.15.6:0/3129223738 >> 172.21.15.6:0/3129223738 conn(0x7fd90806e7b0 msgr2=0x7fd9080b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- 172.21.15.6:0/3129223738 shutdown_connections 2024-04-26T00:50:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- 172.21.15.6:0/3129223738 wait complete. 2024-04-26T00:50:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 Processor -- start 2024-04-26T00:50:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- start start 2024-04-26T00:50:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 0x7fd9080a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd908132620 0x7fd9080a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd908139420 con 0x7fd90814b620 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd908073830 con 0x7fd908132620 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90e6f5640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd9081395a0 con 0x7fd9080a5a90 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 0x7fd9080a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38826/0 (socket says 172.21.15.6:38826) 2024-04-26T00:50:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 -- 172.21.15.6:0/1036373442 learned_addr learned my addr 172.21.15.6:0/1036373442 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd90cc92640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd908132620 0x7fd9080a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 -- 172.21.15.6:0/1036373442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd908132620 msgr2=0x7fd9080a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd908132620 0x7fd9080a4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 -- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 msgr2=0x7fd9080a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 0x7fd9080a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd907fff640 1 -- 172.21.15.6:0/1036373442 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908133b80 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.804+0000 7fd9077fe640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 0x7fd9080a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd907fff640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc01abf0 tx=0x7fd8fc01ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0b4800 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8fc0b49a0 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd908133e40 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0b4d70 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9080b64a0 con 0x7fd9080a5a90 2024-04-26T00:50:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90806db70 con 0x7fd9080a5a90 2024-04-26T00:50:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd8fc0bd390 con 0x7fd9080a5a90 2024-04-26T00:50:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 0x7fd8f409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd9077fe640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 0x7fd8f409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fd8fc15c590 con 0x7fd9080a5a90 2024-04-26T00:50:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.808+0000 7fd9077fe640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 0x7fd8f409b800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd908139960 tx=0x7fd8f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.812+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd8fc0c4060 con 0x7fd9080a5a90 2024-04-26T00:50:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.976+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fd9080a8380 con 0x7fd9080a5a90 2024-04-26T00:50:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.976+0000 7fd904ff9640 1 -- 172.21.15.6:0/1036373442 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) ==== 92+0+10 (secure 0 0 0) 0x7fd8fc016130 con 0x7fd9080a5a90 2024-04-26T00:50:36.985 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 10 mgrc shutdown 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 msgr2=0x7fd8f409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 0x7fd8f409b800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd908139960 tx=0x7fd8f8009040 comp rx=0 tx=0).stop 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 msgr2=0x7fd9080b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc01abf0 tx=0x7fd8fc01ad80 comp rx=0 tx=0).stop 2024-04-26T00:50:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 shutdown_connections 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd8f4099340 0x7fd8f409b800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd908132620 0x7fd9080a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90814b620 0x7fd9080a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 --2- 172.21.15.6:0/1036373442 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9080a5a90 0x7fd9080b5f60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 >> 172.21.15.6:0/1036373442 conn(0x7fd90806e7b0 msgr2=0x7fd90806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 shutdown_connections 2024-04-26T00:50:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:36.980+0000 7fd90e6f5640 1 -- 172.21.15.6:0/1036373442 wait complete. 2024-04-26T00:50:37.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T00:50:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 Processor -- start 2024-04-26T00:50:37.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 -- start start 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3a4144eb0 0x7ff3a414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a41456d0 con 0x7ff3a40ac140 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a40bbab0 con 0x7ff3a4144eb0 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3ab94d640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a4145990 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38828/0 (socket says 172.21.15.6:38828) 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 -- 172.21.15.6:0/2392230750 learned_addr learned my addr 172.21.15.6:0/2392230750 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a9eea640 1 --2- 172.21.15.6:0/2392230750 >> v2:172.21.15.6:3300/0 conn(0x7ff3a4144eb0 0x7ff3a414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 -- 172.21.15.6:0/2392230750 >> v2:172.21.15.6:3300/0 conn(0x7ff3a4144eb0 msgr2=0x7ff3a414f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2392230750 >> v2:172.21.15.6:3300/0 conn(0x7ff3a4144eb0 0x7ff3a414f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 -- 172.21.15.6:0/2392230750 >> v1:172.21.15.188:6789/0 conn(0x7ff3a40ac140 legacy=0x7ff3a41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.112+0000 7ff3a96e9640 1 -- 172.21.15.6:0/2392230750 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a40abd90 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2392230750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009870 tx=0x7ff3a001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d72de438af1cdfd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff39bfff640 1 -- 172.21.15.6:0/2392230750 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00b0070 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff39bfff640 1 -- 172.21.15.6:0/2392230750 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a00ab600 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff39bfff640 1 -- 172.21.15.6:0/2392230750 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00ab9d0 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2392230750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 msgr2=0x7ff3a406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2392230750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009870 tx=0x7ff3a001c500 comp rx=0 tx=0).stop 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2392230750 shutdown_connections 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2392230750 >> v2:172.21.15.6:3300/0 conn(0x7ff3a4144eb0 0x7ff3a414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2392230750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a40bb6d0 0x7ff3a406f250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2392230750 >> 172.21.15.6:0/2392230750 conn(0x7ff3a406e000 msgr2=0x7ff3a40bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2392230750 shutdown_connections 2024-04-26T00:50:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2392230750 wait complete. 2024-04-26T00:50:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 Processor -- start 2024-04-26T00:50:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- start start 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 0x7ff3a413e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4152ab0 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4152930 con 0x7ff3a40ac140 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a4152c30 con 0x7ff3a4144eb0 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a9eea640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38154/0 (socket says 172.21.15.6:38154) 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 -- 172.21.15.6:0/2902968438 learned_addr learned my addr 172.21.15.6:0/2902968438 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a9eea640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38834/0 (socket says 172.21.15.6:38834) 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 0x7ff3a413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 -- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 msgr2=0x7ff3a41e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 -- 172.21.15.6:0/2902968438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 msgr2=0x7ff3a413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 0x7ff3a413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 -- 172.21.15.6:0/2902968438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a41e1910 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 0x7ff3a413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a9eea640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3a8ee8640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c480 tx=0x7ff39400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394012830 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff394017070 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a40a9850 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.116+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394012c30 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a41499c0 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a406db70 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7ff39401c460 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 0x7ff38809b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 0x7ff38809b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7ff3940c2810 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.120+0000 7ff3a96e9640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 0x7ff38809b830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00ad000 tx=0x7ff3a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.124+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff394093af0 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.284+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff3a40ab960 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff399ffb640 1 -- 172.21.15.6:0/2902968438 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+126 (secure 0 0 0) 0x7ff3940933f0 con 0x7ff3a40bb6d0 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-04-26T00:50:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-04-26T00:50:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-04-26T00:50:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2024-04-26T00:50:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2024-04-26T00:50:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-04-26T00:50:37.296 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-04-26T00:50:37.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 10 mgrc shutdown 2024-04-26T00:50:37.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 msgr2=0x7ff38809b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 0x7ff38809b830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00ad000 tx=0x7ff3a0008040 comp rx=0 tx=0).stop 2024-04-26T00:50:37.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 msgr2=0x7ff3a41e0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c480 tx=0x7ff39400c940 comp rx=0 tx=0).stop 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 shutdown_connections 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff388099370 0x7ff38809b830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff3a4144eb0 0x7ff3a41e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40bb6d0 0x7ff3a41e0cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 --2- 172.21.15.6:0/2902968438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3a40ac140 0x7ff3a413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 >> 172.21.15.6:0/2902968438 conn(0x7ff3a406e000 msgr2=0x7ff3a406fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 shutdown_connections 2024-04-26T00:50:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.288+0000 7ff3ab94d640 1 -- 172.21.15.6:0/2902968438 wait complete. 2024-04-26T00:50:37.313 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T00:50:37.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T00:50:37.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 Processor -- start 2024-04-26T00:50:37.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 -- start start 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b40aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f41b4072910 0x7f41b40b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b40a8120 con 0x7f41b40a64d0 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f41b4071310 con 0x7f41b4072910 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41bb84a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f41b4072fc0 con 0x7f41b40a5a90 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b9de7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41b40a64d0 0x7f41b40a68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41098/0 (socket says 172.21.15.6:41098) 2024-04-26T00:50:37.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b9de7640 1 -- 172.21.15.6:0/1383768021 learned_addr learned my addr 172.21.15.6:0/1383768021 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b95e6640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b40aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b8de5640 1 --2- 172.21.15.6:0/1383768021 >> v2:172.21.15.188:3300/0 conn(0x7f41b4072910 0x7f41b40b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41abfff640 1 -- 172.21.15.6:0/1383768021 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841068131 0 0) 0x7f41b40a8120 con 0x7f41b40a64d0 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41abfff640 1 -- 172.21.15.6:0/1383768021 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a0003530 con 0x7f41b40a64d0 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b95e6640 1 -- 172.21.15.6:0/1383768021 >> v2:172.21.15.188:3300/0 conn(0x7f41b4072910 msgr2=0x7f41b40b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b95e6640 1 --2- 172.21.15.6:0/1383768021 >> v2:172.21.15.188:3300/0 conn(0x7f41b4072910 0x7f41b40b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b95e6640 1 -- 172.21.15.6:0/1383768021 >> v1:172.21.15.6:6789/0 conn(0x7f41b40a64d0 legacy=0x7f41b40a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.436+0000 7f41b95e6640 1 -- 172.21.15.6:0/1383768021 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b40aaa90 con 0x7f41b40a5a90 2024-04-26T00:50:37.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41b95e6640 1 --2- 172.21.15.6:0/1383768021 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b40aa410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41a40097c0 tx=0x7f41a401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acbe998377a968e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41abfff640 1 -- 172.21.15.6:0/1383768021 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a40b2070 con 0x7f41b40a5a90 2024-04-26T00:50:37.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41abfff640 1 -- 172.21.15.6:0/1383768021 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a40ad640 con 0x7f41b40a5a90 2024-04-26T00:50:37.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41abfff640 1 -- 172.21.15.6:0/1383768021 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a40ada10 con 0x7f41b40a5a90 2024-04-26T00:50:37.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- 172.21.15.6:0/1383768021 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 msgr2=0x7f41b40aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 --2- 172.21.15.6:0/1383768021 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b40aa410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41a40097c0 tx=0x7f41a401c480 comp rx=0 tx=0).stop 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- 172.21.15.6:0/1383768021 shutdown_connections 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 --2- 172.21.15.6:0/1383768021 >> v2:172.21.15.188:3300/0 conn(0x7f41b4072910 0x7f41b40b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 --2- 172.21.15.6:0/1383768021 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b40aa410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- 172.21.15.6:0/1383768021 >> 172.21.15.6:0/1383768021 conn(0x7f41b406e7b0 msgr2=0x7f41b40b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- 172.21.15.6:0/1383768021 shutdown_connections 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- 172.21.15.6:0/1383768021 wait complete. 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 Processor -- start 2024-04-26T00:50:37.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 -- start start 2024-04-26T00:50:37.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.440+0000 7f41bb84a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b409bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41b409d1a0 0x7f41b409d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40a5e70 con 0x7f41b40a64d0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40a5ff0 con 0x7f41b409d1a0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f41b4139420 con 0x7f41b40a5a90 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38162/0 (socket says 172.21.15.6:38162) 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 -- 172.21.15.6:0/3806230083 learned_addr learned my addr 172.21.15.6:0/3806230083 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b95e6640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b409bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 -- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 msgr2=0x7f41b409bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b409bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b9de7640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41b409d1a0 0x7f41b409d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 -- 172.21.15.6:0/3806230083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41b409d1a0 msgr2=0x7f41b409d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41b409d1a0 0x7f41b409d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 -- 172.21.15.6:0/3806230083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b4099bc0 con 0x7f41b40a64d0 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b95e6640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b409bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b8de5640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009cd0 tx=0x7f41ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac018020 con 0x7f41b40a64d0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac014480 con 0x7f41b40a64d0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b409db70 con 0x7f41b40a64d0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac014850 con 0x7f41b40a64d0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b409e680 con 0x7f41b40a64d0 2024-04-26T00:50:37.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b406db70 con 0x7f41b40a64d0 2024-04-26T00:50:37.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f41ac01b020 con 0x7f41b40a64d0 2024-04-26T00:50:37.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:37.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:37.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 0x7f419809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f41ac0c3530 con 0x7f41b40a64d0 2024-04-26T00:50:37.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.444+0000 7f41b95e6640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 0x7f419809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.448+0000 7f41b95e6640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 0x7f419809b800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41a40af000 tx=0x7f41a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.448+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f41ac022020 con 0x7f41b40a64d0 2024-04-26T00:50:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.612+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f41b40b6cf0 con 0x7f41b40a64d0 2024-04-26T00:50:37.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.804+0000 7f41a9ffb640 1 -- 172.21.15.6:0/3806230083 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f41ac010040 con 0x7f41b40a64d0 2024-04-26T00:50:37.815 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 10 mgrc shutdown 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 msgr2=0x7f419809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 0x7f419809b800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41a40af000 tx=0x7f41a4008040 comp rx=0 tx=0).stop 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 msgr2=0x7f41b4143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009cd0 tx=0x7f41ac00c490 comp rx=0 tx=0).stop 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 shutdown_connections 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4198099340 0x7f419809b800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41b409d1a0 0x7f41b409d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b40a64d0 0x7f41b4143310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 --2- 172.21.15.6:0/3806230083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41b40a5a90 0x7f41b409bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 >> 172.21.15.6:0/3806230083 conn(0x7f41b406e7b0 msgr2=0x7f41b40a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:37.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.808+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 shutdown_connections 2024-04-26T00:50:37.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.812+0000 7f41bb84a640 1 -- 172.21.15.6:0/3806230083 wait complete. 2024-04-26T00:50:37.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T00:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 Processor -- start 2024-04-26T00:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 -- start start 2024-04-26T00:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc480accd0 0x7fdc4813b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc48148b90 con 0x7fdc4806fd40 2024-04-26T00:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc48148e50 con 0x7fdc481485e0 2024-04-26T00:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4e710640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4806f810 con 0x7fdc480accd0 2024-04-26T00:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4ccad640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc4806fd40 0x7fdc4814f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41108/0 (socket says 172.21.15.6:41108) 2024-04-26T00:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4ccad640 1 -- 172.21.15.6:0/1581071890 learned_addr learned my addr 172.21.15.6:0/1581071890 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1581071890 >> v2:172.21.15.188:3300/0 conn(0x7fdc480accd0 0x7fdc4813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493926981 0 0) 0x7fdc48148b90 con 0x7fdc4806fd40 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc34003530 con 0x7fdc4806fd40 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715581975 0 0) 0x7fdc34003530 con 0x7fdc4806fd40 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 >> v2:172.21.15.188:3300/0 conn(0x7fdc480accd0 msgr2=0x7fdc4813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 --2- 172.21.15.6:0/1581071890 >> v2:172.21.15.188:3300/0 conn(0x7fdc480accd0 0x7fdc4813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 >> v1:172.21.15.188:6789/0 conn(0x7fdc481485e0 legacy=0x7fdc480aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc48070150 con 0x7fdc4806fd40 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7fdc40001680 con 0x7fdc4806fd40 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 >> v1:172.21.15.6:6789/0 conn(0x7fdc4806fd40 legacy=0x7fdc4814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc34004810 0x7fdc34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc340052f0 0x7fdc3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4806f810 con 0x7fdc340039c0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3400c1c0 con 0x7fdc340052f0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3400c3c0 con 0x7fdc34004810 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc477fe640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc34004810 0x7fdc34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4ccad640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc340052f0 0x7fdc3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 -- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc34004810 msgr2=0x7fdc34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc34004810 0x7fdc34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 -- 172.21.15.6:0/1581071890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc340052f0 msgr2=0x7fdc3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc340052f0 0x7fdc3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc47fff640 1 -- 172.21.15.6:0/1581071890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc34003530 con 0x7fdc340039c0 2024-04-26T00:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4ccad640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc340052f0 0x7fdc3400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.968+0000 7fdc4ccad640 1 -- 172.21.15.6:0/1581071890 reap_dead start 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc34003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009ab0 tx=0x7fdc3001cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4039fd6e3d73d446 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc300b2070 con 0x7fdc340039c0 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc300a5530 con 0x7fdc340039c0 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc46ffd640 1 -- 172.21.15.6:0/1581071890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc300096b0 con 0x7fdc340039c0 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 msgr2=0x7fdc34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc34003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009ab0 tx=0x7fdc3001cac0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- 172.21.15.6:0/1581071890 shutdown_connections 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1581071890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc34003de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- 172.21.15.6:0/1581071890 >> 172.21.15.6:0/1581071890 conn(0x7fdc4806e500 msgr2=0x7fdc480bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- 172.21.15.6:0/1581071890 shutdown_connections 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- 172.21.15.6:0/1581071890 wait complete. 2024-04-26T00:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 Processor -- start 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.972+0000 7fdc4e710640 1 -- start start 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 0x7fdc481de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc480b49a0 0x7fdc480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481379b0 con 0x7fdc340039c0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480a8450 con 0x7fdc480b49a0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fdc48137b30 con 0x7fdc481dddb0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 0x7fdc481de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38174/0 (socket says 172.21.15.6:38174) 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc47fff640 1 -- 172.21.15.6:0/1171026246 learned_addr learned my addr 172.21.15.6:0/1171026246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4ccad640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc480b49a0 0x7fdc480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 -- 172.21.15.6:0/1171026246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc480b49a0 msgr2=0x7fdc480b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc480b49a0 0x7fdc480b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 -- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 msgr2=0x7fdc480b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 -- 172.21.15.6:0/1171026246 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481d4460 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc477fe640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 0x7fdc481de1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800f930 tx=0x7fdc3800fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3801a070 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc38006d70 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc481dea40 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38003ba0 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc480b5aa0 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4806db70 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fdc3801d070 con 0x7fdc481dddb0 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 0x7fdc2809b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3852+0+0 (secure 0 0 0) 0x7fdc380c1bf0 con 0x7fdc481dddb0 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.976+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 0x7fdc2809b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.980+0000 7fdc47fff640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 0x7fdc2809b830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc30000c10 tx=0x7fdc300a7040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:37.980+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdc38092cc0 con 0x7fdc481dddb0 2024-04-26T00:50:38.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.144+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdc48146ab0 con 0x7fdc481dddb0 2024-04-26T00:50:38.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.836+0000 7fdc44ff9640 1 -- 172.21.15.6:0/1171026246 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fdc380925c0 con 0x7fdc481dddb0 2024-04-26T00:50:38.847 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-04-26T00:50:38.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 10 mgrc shutdown 2024-04-26T00:50:38.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 msgr2=0x7fdc2809b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 0x7fdc2809b830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc30000c10 tx=0x7fdc300a7040 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 msgr2=0x7fdc481de1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 0x7fdc481de1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800f930 tx=0x7fdc3800fdf0 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 shutdown_connections 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fdc28099370 0x7fdc2809b830 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc480b49a0 0x7fdc480b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc481dddb0 0x7fdc481de1b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 --2- 172.21.15.6:0/1171026246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc340039c0 0x7fdc480b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 >> 172.21.15.6:0/1171026246 conn(0x7fdc4806e500 msgr2=0x7fdc480ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 shutdown_connections 2024-04-26T00:50:38.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.840+0000 7fdc4e710640 1 -- 172.21.15.6:0/1171026246 wait complete. 2024-04-26T00:50:38.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T00:50:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 Processor -- start 2024-04-26T00:50:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 -- start start 2024-04-26T00:50:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a5406b1a0 0x7f7a54148430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a54148b80 con 0x7f7a5406b580 2024-04-26T00:50:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a54148e40 con 0x7f7a5413b530 2024-04-26T00:50:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5bb54640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540b3940 con 0x7f7a5406b1a0 2024-04-26T00:50:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a590ef640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a5406b580 0x7f7a540ad600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41110/0 (socket says 172.21.15.6:41110) 2024-04-26T00:50:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a590ef640 1 -- 172.21.15.6:0/1322371261 learned_addr learned my addr 172.21.15.6:0/1322371261 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a598f0640 1 --2- 172.21.15.6:0/1322371261 >> v2:172.21.15.188:3300/0 conn(0x7f7a5406b1a0 0x7f7a54148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712536392 0 0) 0x7f7a54148b80 con 0x7f7a5406b580 2024-04-26T00:50:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a40003530 con 0x7f7a5406b580 2024-04-26T00:50:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205578188 0 0) 0x7f7a40003530 con 0x7f7a5406b580 2024-04-26T00:50:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 >> v2:172.21.15.188:3300/0 conn(0x7f7a5406b1a0 msgr2=0x7f7a54148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 --2- 172.21.15.6:0/1322371261 >> v2:172.21.15.188:3300/0 conn(0x7f7a5406b1a0 0x7f7a54148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 >> v1:172.21.15.188:6789/0 conn(0x7f7a5413b530 legacy=0x7f7a5414f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a54071650 con 0x7f7a5406b580 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f7a500016a0 con 0x7f7a5406b580 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 >> v1:172.21.15.6:6789/0 conn(0x7f7a5406b580 legacy=0x7f7a540ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40003a30 0x7f7a40003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a40004810 0x7f7a40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 0x7f7a4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540b3940 con 0x7f7a40005240 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4000c1a0 con 0x7f7a40003a30 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4000c3a0 con 0x7f7a40004810 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 0x7f7a4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a590ef640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a40004810 0x7f7a40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a598f0640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40003a30 0x7f7a40003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 -- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a40004810 msgr2=0x7f7a40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a40004810 0x7f7a40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 -- 172.21.15.6:0/1322371261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40003a30 msgr2=0x7f7a40003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40003a30 0x7f7a40003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:38.996+0000 7f7a5a0f1640 1 -- 172.21.15.6:0/1322371261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40003530 con 0x7f7a40005240 2024-04-26T00:50:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5a0f1640 1 -- 172.21.15.6:0/1322371261 reap_dead start 2024-04-26T00:50:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5a0f1640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 0x7f7a4000b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001e40 tx=0x7f7a4c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d949ee39a44f9e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c001a90 con 0x7f7a40005240 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c003b80 con 0x7f7a40005240 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a588ee640 1 -- 172.21.15.6:0/1322371261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0050d0 con 0x7f7a40005240 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 msgr2=0x7f7a4000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 0x7f7a4000b9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001e40 tx=0x7f7a4c01c360 comp rx=0 tx=0).stop 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1322371261 shutdown_connections 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1322371261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a40005240 0x7f7a4000b9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1322371261 >> 172.21.15.6:0/1322371261 conn(0x7f7a540b3c30 msgr2=0x7f7a540b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1322371261 shutdown_connections 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1322371261 wait complete. 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 Processor -- start 2024-04-26T00:50:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.000+0000 7f7a5bb54640 1 -- start start 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40005240 0x7f7a54149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 0x7f7a540b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540ad990 con 0x7f7a5412c8d0 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540ad810 con 0x7f7a40005240 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7a540adb10 con 0x7f7a5412cd10 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5a0f1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 0x7f7a540b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38192/0 (socket says 172.21.15.6:38192) 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 -- 172.21.15.6:0/1946668567 learned_addr learned my addr 172.21.15.6:0/1946668567 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a598f0640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40005240 0x7f7a54149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 -- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 msgr2=0x7f7a540b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 0x7f7a540b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 -- 172.21.15.6:0/1946668567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40005240 msgr2=0x7f7a54149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40005240 0x7f7a54149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 -- 172.21.15.6:0/1946668567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a540ae330 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5a0f1640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 0x7f7a540b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a590ef640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005880 tx=0x7f7a500126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5001c070 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a50014750 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a540ae5f0 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50014b40 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a54149550 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5406db70 con 0x7f7a5412c8d0 2024-04-26T00:50:39.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f7a5001f070 con 0x7f7a5412c8d0 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 0x7f7a3809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a598f0640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 0x7f7a3809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.004+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4234+0+0 (secure 0 0 0) 0x7f7a500c4e30 con 0x7f7a5412c8d0 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.008+0000 7f7a598f0640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 0x7f7a3809b800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a440099c0 tx=0x7f7a44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.008+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7a500957d0 con 0x7f7a5412c8d0 2024-04-26T00:50:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.204+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7a5406fc70 con 0x7f7a5412c8d0 2024-04-26T00:50:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.820+0000 7f7a4a7fc640 1 -- 172.21.15.6:0/1946668567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7a50099ad0 con 0x7f7a5412c8d0 2024-04-26T00:50:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 10 mgrc shutdown 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 msgr2=0x7f7a3809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 0x7f7a3809b800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a440099c0 tx=0x7f7a44008040 comp rx=0 tx=0).stop 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 msgr2=0x7f7a540b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005880 tx=0x7f7a500126f0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 shutdown_connections 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7a38099340 0x7f7a3809b800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7a5412cd10 0x7f7a540b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5412c8d0 0x7f7a540b1780 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005880 tx=0x7f7a500126f0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 --2- 172.21.15.6:0/1946668567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a40005240 0x7f7a54149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 >> 172.21.15.6:0/1946668567 conn(0x7f7a540b3c30 msgr2=0x7f7a54148430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 shutdown_connections 2024-04-26T00:50:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.824+0000 7f7a5bb54640 1 -- 172.21.15.6:0/1946668567 wait complete. 2024-04-26T00:50:39.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 Processor -- start 2024-04-26T00:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 -- start start 2024-04-26T00:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84140a7b30 0x7f84140a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f84140729c0 0x7f8414070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f841406f0e0 con 0x7f84140a7b30 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f841406f6e0 con 0x7f84140729c0 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.980+0000 7f841bfc3640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f841406f9a0 con 0x7f8414137ca0 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841955e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84140a7b30 0x7f84140a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84140a7b30 0x7f84140a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38206/0 (socket says 172.21.15.6:38206) 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 -- 172.21.15.6:0/320566284 learned_addr learned my addr 172.21.15.6:0/320566284 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841955e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38886/0 (socket says 172.21.15.6:38886) 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841a560640 1 --2- 172.21.15.6:0/320566284 >> v2:172.21.15.188:3300/0 conn(0x7f84140729c0 0x7f8414070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 -- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 msgr2=0x7f8414071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 -- 172.21.15.6:0/320566284 >> v2:172.21.15.188:3300/0 conn(0x7f84140729c0 msgr2=0x7f8414070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 --2- 172.21.15.6:0/320566284 >> v2:172.21.15.188:3300/0 conn(0x7f84140729c0 0x7f8414070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 -- 172.21.15.6:0/320566284 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841406fc60 con 0x7f84140a7b30 2024-04-26T00:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841955e640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8419d5f640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84140a7b30 0x7f84140a7f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8414071240 tx=0x7f841001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f704a08cc954c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8418d5d640 1 -- 172.21.15.6:0/320566284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100b4070 con 0x7f84140a7b30 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8418d5d640 1 -- 172.21.15.6:0/320566284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100a7ae0 con 0x7f84140a7b30 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f8418d5d640 1 -- 172.21.15.6:0/320566284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100af440 con 0x7f84140a7b30 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 -- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84140a7b30 msgr2=0x7f84140a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84140a7b30 0x7f84140a7f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8414071240 tx=0x7f841001eab0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 -- 172.21.15.6:0/320566284 shutdown_connections 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 --2- 172.21.15.6:0/320566284 >> v2:172.21.15.188:3300/0 conn(0x7f84140729c0 0x7f8414070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8414137ca0 0x7f8414071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 --2- 172.21.15.6:0/320566284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84140a7b30 0x7f84140a7f10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 -- 172.21.15.6:0/320566284 >> 172.21.15.6:0/320566284 conn(0x7f841406e230 msgr2=0x7f84140b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 -- 172.21.15.6:0/320566284 shutdown_connections 2024-04-26T00:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.984+0000 7f841bfc3640 1 -- 172.21.15.6:0/320566284 wait complete. 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 Processor -- start 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- start start 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 0x7f841409dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414137ca0 0x7f84141e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8414144f10 con 0x7f8414137ca0 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8414144d90 con 0x7f84140729c0 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8414145090 con 0x7f84140a7b30 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38894/0 (socket says 172.21.15.6:38894) 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 -- 172.21.15.6:0/3186469177 learned_addr learned my addr 172.21.15.6:0/3186469177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841a560640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414137ca0 0x7f84141e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f8419d5f640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 0x7f841409dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 -- 172.21.15.6:0/3186469177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 msgr2=0x7f841409dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 0x7f841409dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 -- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414137ca0 msgr2=0x7f84141e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414137ca0 0x7f84141e14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 -- 172.21.15.6:0/3186469177 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841414b390 con 0x7f84140a7b30 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f8419d5f640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 0x7f841409dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841955e640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f840400ea00 tx=0x7f840400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404017070 con 0x7f84140a7b30 2024-04-26T00:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840400ca60 con 0x7f84140a7b30 2024-04-26T00:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841409e110 con 0x7f84140a7b30 2024-04-26T00:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840400ce50 con 0x7f84140a7b30 2024-04-26T00:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8414099df0 con 0x7f84140a7b30 2024-04-26T00:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.988+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841406db70 con 0x7f84140a7b30 2024-04-26T00:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f840401a070 con 0x7f84140a7b30 2024-04-26T00:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 0x7f83f809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f8419d5f640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 0x7f83f809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f84040c2680 con 0x7f84140a7b30 2024-04-26T00:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.992+0000 7f8419d5f640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 0x7f83f809b800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84100b1000 tx=0x7f8410008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:39.996+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8404093570 con 0x7f84140a7b30 2024-04-26T00:50:40.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.156+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84140b5130 con 0x7f84140a7b30 2024-04-26T00:50:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f840a7fc640 1 -- 172.21.15.6:0/3186469177 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+13562 (secure 0 0 0) 0x7f8404092e70 con 0x7f84140a7b30 2024-04-26T00:50:40.168 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:40.168 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:39.211326+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 10 mgrc shutdown 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 msgr2=0x7f83f809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 0x7f83f809b800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84100b1000 tx=0x7f8410008040 comp rx=0 tx=0).stop 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 msgr2=0x7f841414a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f840400ea00 tx=0x7f840400eec0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 shutdown_connections 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f83f8099340 0x7f83f809b800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8414137ca0 0x7f84141e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84140a7b30 0x7f841414a9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 --2- 172.21.15.6:0/3186469177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84140729c0 0x7f841409dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 >> 172.21.15.6:0/3186469177 conn(0x7f841406e230 msgr2=0x7f8414074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.160+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 shutdown_connections 2024-04-26T00:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.164+0000 7f841bfc3640 1 -- 172.21.15.6:0/3186469177 wait complete. 2024-04-26T00:50:40.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.304+0000 7f075cff8640 1 Processor -- start 2024-04-26T00:50:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.304+0000 7f075cff8640 1 -- start start 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07580a41a0 0x7f0758137f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0758138450 0x7f0758148490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f07580a5350 con 0x7f07580a41a0 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f07580a39c0 con 0x7f0758138450 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075cff8640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f07580a48a0 con 0x7f07580a6d80 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07580a41a0 0x7f0758137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38898/0 (socket says 172.21.15.6:38898) 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075659c640 1 -- 172.21.15.6:0/1032743548 learned_addr learned my addr 172.21.15.6:0/1032743548 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07580a41a0 0x7f0758137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38226/0 (socket says 172.21.15.6:38226) 2024-04-26T00:50:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0756d9d640 1 --2- 172.21.15.6:0/1032743548 >> v2:172.21.15.188:3300/0 conn(0x7f0758138450 0x7f0758148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 -- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 msgr2=0x7f075806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 -- 172.21.15.6:0/1032743548 >> v2:172.21.15.188:3300/0 conn(0x7f0758138450 msgr2=0x7f0758148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 --2- 172.21.15.6:0/1032743548 >> v2:172.21.15.188:3300/0 conn(0x7f0758138450 0x7f0758148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 -- 172.21.15.6:0/1032743548 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07580a4b60 con 0x7f07580a41a0 2024-04-26T00:50:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075659c640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f0755d9b640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758137f10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f075813b540 tx=0x7f074001c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5d4d096766eea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075559a640 1 -- 172.21.15.6:0/1032743548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400b0070 con 0x7f07580a41a0 2024-04-26T00:50:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075559a640 1 -- 172.21.15.6:0/1032743548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400ab600 con 0x7f07580a41a0 2024-04-26T00:50:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.308+0000 7f075559a640 1 -- 172.21.15.6:0/1032743548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400ab9d0 con 0x7f07580a41a0 2024-04-26T00:50:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 msgr2=0x7f0758137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758137f10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f075813b540 tx=0x7f074001c080 comp rx=0 tx=0).stop 2024-04-26T00:50:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/1032743548 shutdown_connections 2024-04-26T00:50:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758137f10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- 172.21.15.6:0/1032743548 >> v2:172.21.15.188:3300/0 conn(0x7f0758138450 0x7f0758148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- 172.21.15.6:0/1032743548 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07580a6d80 0x7f075806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/1032743548 >> 172.21.15.6:0/1032743548 conn(0x7f07580b71a0 msgr2=0x7f07580b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/1032743548 shutdown_connections 2024-04-26T00:50:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/1032743548 wait complete. 2024-04-26T00:50:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 Processor -- start 2024-04-26T00:50:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- start start 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 0x7f0758070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 0x7f07581e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f075813b730 con 0x7f07580a41a0 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f075813b5b0 con 0x7f07580a6d80 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f07581517d0 con 0x7f0758138450 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38240/0 (socket says 172.21.15.6:38240) 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 -- 172.21.15.6:0/3359653689 learned_addr learned my addr 172.21.15.6:0/3359653689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f0756d9d640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 0x7f07581e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f0755d9b640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 0x7f0758070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 -- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 msgr2=0x7f07581e0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 0x7f07581e0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 -- 172.21.15.6:0/3359653689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 msgr2=0x7f0758070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 0x7f0758070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 -- 172.21.15.6:0/3359653689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758070170 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f0755d9b640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 0x7f0758070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f0756d9d640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 0x7f07581e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075659c640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f074800efc0 tx=0x7f074800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748014480 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748019070 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0758145290 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748014820 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075806f750 con 0x7f07580a41a0 2024-04-26T00:50:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.312+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075806db70 con 0x7f07580a41a0 2024-04-26T00:50:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f0748012050 con 0x7f07580a41a0 2024-04-26T00:50:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 0x7f073809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f0755d9b640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 0x7f073809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f07480c33b0 con 0x7f07580a41a0 2024-04-26T00:50:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.316+0000 7f0755d9b640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 0x7f073809b800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f07400ad000 tx=0x7f0740008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.320+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0758145290 con 0x7f07580a41a0 2024-04-26T00:50:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.480+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07580b5590 con 0x7f07580a41a0 2024-04-26T00:50:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f074effd640 1 -- 172.21.15.6:0/3359653689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+13562 (secure 0 0 0) 0x7f0748010040 con 0x7f07580a41a0 2024-04-26T00:50:40.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:40.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:39.211326+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 10 mgrc shutdown 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 msgr2=0x7f073809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 0x7f073809b800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f07400ad000 tx=0x7f0740008040 comp rx=0 tx=0).stop 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 msgr2=0x7f0758147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f074800efc0 tx=0x7f074800c490 comp rx=0 tx=0).stop 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 shutdown_connections 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0738099340 0x7f073809b800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0758138450 0x7f07581e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07580a6d80 0x7f0758070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 --2- 172.21.15.6:0/3359653689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07580a41a0 0x7f0758147bc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 >> 172.21.15.6:0/3359653689 conn(0x7f07580b71a0 msgr2=0x7f0758074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 shutdown_connections 2024-04-26T00:50:40.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.484+0000 7f075cff8640 1 -- 172.21.15.6:0/3359653689 wait complete. 2024-04-26T00:50:40.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T00:50:40.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 Processor -- start 2024-04-26T00:50:40.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 -- start start 2024-04-26T00:50:40.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28e40b9570 0x7f28e40733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 0x7f28e4072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e40a9e30 con 0x7f28e40715b0 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40b9950 con 0x7f28e40b9570 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28ea457640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f28e41353f0 con 0x7f28e41393f0 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28e40b9570 0x7f28e40733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e89f4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28e40715b0 0x7f28e4135c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41112/0 (socket says 172.21.15.6:41112) 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e89f4640 1 -- 172.21.15.6:0/598656297 learned_addr learned my addr 172.21.15.6:0/598656297 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e37fe640 1 --2- 172.21.15.6:0/598656297 >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 0x7f28e4072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 -- 172.21.15.6:0/598656297 >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 msgr2=0x7f28e4072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 --2- 172.21.15.6:0/598656297 >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 0x7f28e4072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 -- 172.21.15.6:0/598656297 >> v1:172.21.15.6:6789/0 conn(0x7f28e40715b0 legacy=0x7f28e4135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 -- 172.21.15.6:0/598656297 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e4136350 con 0x7f28e40b9570 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e2ffd640 1 -- 172.21.15.6:0/598656297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166234729 0 0) 0x7f28e40a9e30 con 0x7f28e40715b0 2024-04-26T00:50:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e37fe640 1 --2- 172.21.15.6:0/598656297 >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 0x7f28e4072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.636+0000 7f28e3fff640 1 --2- 172.21.15.6:0/598656297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e40b9570 0x7f28e40733f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28e41398d0 tx=0x7f28d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde6941fe2af728 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e2ffd640 1 -- 172.21.15.6:0/598656297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40ab680 con 0x7f28e40b9570 2024-04-26T00:50:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e2ffd640 1 -- 172.21.15.6:0/598656297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40b0070 con 0x7f28e40b9570 2024-04-26T00:50:40.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e2ffd640 1 -- 172.21.15.6:0/598656297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40aba40 con 0x7f28e40b9570 2024-04-26T00:50:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/598656297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e40b9570 msgr2=0x7f28e40733f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- 172.21.15.6:0/598656297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e40b9570 0x7f28e40733f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28e41398d0 tx=0x7f28d401c460 comp rx=0 tx=0).stop 2024-04-26T00:50:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/598656297 shutdown_connections 2024-04-26T00:50:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- 172.21.15.6:0/598656297 >> v2:172.21.15.188:3300/0 conn(0x7f28e41393f0 0x7f28e4072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- 172.21.15.6:0/598656297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e40b9570 0x7f28e40733f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/598656297 >> 172.21.15.6:0/598656297 conn(0x7f28e4070710 msgr2=0x7f28e40b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/598656297 shutdown_connections 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/598656297 wait complete. 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 Processor -- start 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- start start 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 0x7f28e41348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4150190 con 0x7f28e41393f0 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4150010 con 0x7f28e40715b0 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f28e4150310 con 0x7f28e40b9570 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e37fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38246/0 (socket says 172.21.15.6:38246) 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 -- 172.21.15.6:0/2959925267 learned_addr learned my addr 172.21.15.6:0/2959925267 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e37fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38916/0 (socket says 172.21.15.6:38916) 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e3fff640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 0x7f28e41348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 -- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 msgr2=0x7f28e409ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 -- 172.21.15.6:0/2959925267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 msgr2=0x7f28e41348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 0x7f28e41348e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 -- 172.21.15.6:0/2959925267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e40b5840 con 0x7f28e41393f0 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e37fe640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e3fff640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 0x7f28e41348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e89f4640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00cb20 tx=0x7f28dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00aca0 con 0x7f28e41393f0 2024-04-26T00:50:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc012400 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00ae60 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e40b5b00 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.640+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41350b0 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e406db70 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f28dc0127f0 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 0x7f28d009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f28dc0c33e0 con 0x7f28e41393f0 2024-04-26T00:50:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e3fff640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 0x7f28d009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:40.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.644+0000 7f28e3fff640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 0x7f28d009b880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f28d40af000 tx=0x7f28d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:40.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.648+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f28dc0942d0 con 0x7f28e41393f0 2024-04-26T00:50:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:40.852+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f28e4137f40 con 0x7f28e41393f0 2024-04-26T00:50:41.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.852+0000 7f28e0ff9640 1 -- 172.21.15.6:0/2959925267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f28dc093bd0 con 0x7f28e41393f0 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 10 mgrc shutdown 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 msgr2=0x7f28d009b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 0x7f28d009b880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f28d40af000 tx=0x7f28d4008040 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 msgr2=0x7f28e41e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00cb20 tx=0x7f28dc00a060 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 shutdown_connections 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f28d00993c0 0x7f28d009b880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e41393f0 0x7f28e41e09d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28e40b9570 0x7f28e409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 --2- 172.21.15.6:0/2959925267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28e40715b0 0x7f28e41348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 >> 172.21.15.6:0/2959925267 conn(0x7f28e4070710 msgr2=0x7f28e41372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:41.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.856+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 shutdown_connections 2024-04-26T00:50:41.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:41.860+0000 7f28ea457640 1 -- 172.21.15.6:0/2959925267 wait complete. 2024-04-26T00:50:41.888 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T00:50:41.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T00:50:42.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 Processor -- start 2024-04-26T00:50:42.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 -- start start 2024-04-26T00:50:42.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0000a5a90 0x7fb0000aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb00014da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0000a8120 con 0x7fb000072910 2024-04-26T00:50:42.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb000071310 con 0x7fb0000a5a90 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb006d09640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fb000072fc0 con 0x7fb00014b620 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0000a5a90 0x7fb0000aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0000a5a90 0x7fb0000aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38250/0 (socket says 172.21.15.6:38250) 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7faffffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb000072910 0x7fb0000b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41116/0 (socket says 172.21.15.6:41116) 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 -- 172.21.15.6:0/3930264092 learned_addr learned my addr 172.21.15.6:0/3930264092 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb0052a6640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb00014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 -- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 msgr2=0x7fb00014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb00014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 -- 172.21.15.6:0/3930264092 >> v1:172.21.15.6:6789/0 conn(0x7fb000072910 legacy=0x7fb0000b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb004aa5640 1 -- 172.21.15.6:0/3930264092 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0000aaa90 con 0x7fb0000a5a90 2024-04-26T00:50:42.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fafff7fe640 1 -- 172.21.15.6:0/3930264092 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197418308 0 0) 0x7fb0000a8120 con 0x7fb000072910 2024-04-26T00:50:42.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.012+0000 7fb0052a6640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb00014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb004aa5640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0000a5a90 0x7fb0000aa410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99157eb0403f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fafff7fe640 1 -- 172.21.15.6:0/3930264092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00ab430 con 0x7fb0000a5a90 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fafff7fe640 1 -- 172.21.15.6:0/3930264092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00b0070 con 0x7fb0000a5a90 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fafff7fe640 1 -- 172.21.15.6:0/3930264092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00ab7f0 con 0x7fb0000a5a90 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0000a5a90 msgr2=0x7fb0000aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0000a5a90 0x7fb0000aa410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff001c520 comp rx=0 tx=0).stop 2024-04-26T00:50:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- 172.21.15.6:0/3930264092 shutdown_connections 2024-04-26T00:50:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb00014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- 172.21.15.6:0/3930264092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0000a5a90 0x7fb0000aa410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- 172.21.15.6:0/3930264092 >> 172.21.15.6:0/3930264092 conn(0x7fb00006e7b0 msgr2=0x7fb0000b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- 172.21.15.6:0/3930264092 shutdown_connections 2024-04-26T00:50:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- 172.21.15.6:0/3930264092 wait complete. 2024-04-26T00:50:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 Processor -- start 2024-04-26T00:50:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- start start 2024-04-26T00:50:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0000a5a90 0x7fb000134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb0001461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb000139420 con 0x7fb00006f100 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0001395a0 con 0x7fb0000a5a90 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb006d09640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fb000150770 con 0x7fb00014b620 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38254/0 (socket says 172.21.15.6:38254) 2024-04-26T00:50:42.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7faffffff640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb0001461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 -- 172.21.15.6:0/2653368888 learned_addr learned my addr 172.21.15.6:0/2653368888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 -- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 msgr2=0x7fb0001461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb0001461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb004aa5640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0000a5a90 0x7fb000134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 -- 172.21.15.6:0/2653368888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0000a5a90 msgr2=0x7fb000134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0000a5a90 0x7fb000134e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 -- 172.21.15.6:0/2653368888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0000a1410 con 0x7fb00006f100 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.016+0000 7fb0052a6640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faff800efc0 tx=0x7faff8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8018020 con 0x7fb00006f100 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8014480 con 0x7fb00006f100 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb000070490 con 0x7fb00006f100 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8014870 con 0x7fb00006f100 2024-04-26T00:50:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00009f6c0 con 0x7fb00006f100 2024-04-26T00:50:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00006db70 con 0x7fb00006f100 2024-04-26T00:50:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7faff801b020 con 0x7fb00006f100 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 0x7fafec09b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7faff80c39c0 con 0x7fb00006f100 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7fb004aa5640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 0x7fafec09b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.020+0000 7fb004aa5640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 0x7fafec09b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faff00af000 tx=0x7faff00a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.024+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7faff8022020 con 0x7fb00006f100 2024-04-26T00:50:42.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.220+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb00014b400 con 0x7fb00006f100 2024-04-26T00:50:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.864+0000 7faffd7fa640 1 -- 172.21.15.6:0/2653368888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7faff8010040 con 0x7fb00006f100 2024-04-26T00:50:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 10 mgrc shutdown 2024-04-26T00:50:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 msgr2=0x7fafec09b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 0x7fafec09b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faff00af000 tx=0x7faff00a7000 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 msgr2=0x7fb00006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faff800efc0 tx=0x7faff8009f90 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 shutdown_connections 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fafec0993c0 0x7fafec09b880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00006f100 0x7fb00006f580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb00014b620 0x7fb0001461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 --2- 172.21.15.6:0/2653368888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0000a5a90 0x7fb000134e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 >> 172.21.15.6:0/2653368888 conn(0x7fb00006e7b0 msgr2=0x7fb00006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 shutdown_connections 2024-04-26T00:50:42.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:42.868+0000 7fb006d09640 1 -- 172.21.15.6:0/2653368888 wait complete. 2024-04-26T00:50:42.898 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T00:50:42.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:50:43.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 Processor -- start 2024-04-26T00:50:43.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 -- start start 2024-04-26T00:50:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cf8148ed0 0x7f9cf80b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf80a3df0 con 0x7f9cf80a33f0 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf80a4b30 con 0x7f9cf8148ed0 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cfe5c1640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf80a4df0 con 0x7f9cf80a4560 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38936/0 (socket says 172.21.15.6:38936) 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 -- 172.21.15.6:0/3845039253 learned_addr learned my addr 172.21.15.6:0/3845039253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf7fff640 1 --2- 172.21.15.6:0/3845039253 >> v2:172.21.15.188:3300/0 conn(0x7f9cf8148ed0 0x7f9cf80b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 -- 172.21.15.6:0/3845039253 >> v2:172.21.15.188:3300/0 conn(0x7f9cf8148ed0 msgr2=0x7f9cf80b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3845039253 >> v2:172.21.15.188:3300/0 conn(0x7f9cf8148ed0 0x7f9cf80b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 -- 172.21.15.6:0/3845039253 >> v1:172.21.15.188:6789/0 conn(0x7f9cf80a33f0 legacy=0x7f9cf80a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.016+0000 7f9cf77fe640 1 -- 172.21.15.6:0/3845039253 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf80a4060 con 0x7f9cf80a4560 2024-04-26T00:50:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3845039253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00098a0 tx=0x7f9ce001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b2ca6b834753bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf6ffd640 1 -- 172.21.15.6:0/3845039253 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00b0070 con 0x7f9cf80a4560 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf6ffd640 1 -- 172.21.15.6:0/3845039253 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce0004230 con 0x7f9cf80a4560 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf6ffd640 1 -- 172.21.15.6:0/3845039253 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003620 con 0x7f9cf80a4560 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3845039253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 msgr2=0x7f9cf80a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3845039253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00098a0 tx=0x7f9ce001c520 comp rx=0 tx=0).stop 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3845039253 shutdown_connections 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3845039253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a4560 0x7f9cf80a2eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3845039253 >> v2:172.21.15.188:3300/0 conn(0x7f9cf8148ed0 0x7f9cf80b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3845039253 >> 172.21.15.6:0/3845039253 conn(0x7f9cf806e230 msgr2=0x7f9cf80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3845039253 shutdown_connections 2024-04-26T00:50:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3845039253 wait complete. 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 Processor -- start 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- start start 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 0x7f9cf80b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cf8148ed0 0x7f9cf8140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80a2570 con 0x7f9cf8148ed0 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80a23f0 con 0x7f9cf80a4560 2024-04-26T00:50:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf8156e40 con 0x7f9cf80a33f0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38944/0 (socket says 172.21.15.6:38944) 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 -- 172.21.15.6:0/3421357187 learned_addr learned my addr 172.21.15.6:0/3421357187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfcb5e640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cf8148ed0 0x7f9cf8140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 0x7f9cf80b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 -- 172.21.15.6:0/3421357187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 msgr2=0x7f9cf80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 0x7f9cf80b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 -- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cf8148ed0 msgr2=0x7f9cf8140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cf8148ed0 0x7f9cf8140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 -- 172.21.15.6:0/3421357187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf80b53d0 con 0x7f9cf80a33f0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 0x7f9cf80b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf7fff640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800d5f0 tx=0x7f9ce800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80125f0 con 0x7f9cf80a33f0 2024-04-26T00:50:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce8019070 con 0x7f9cf80a33f0 2024-04-26T00:50:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf80b5690 con 0x7f9cf80a33f0 2024-04-26T00:50:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80129b0 con 0x7f9cf80a33f0 2024-04-26T00:50:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.020+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf8139660 con 0x7f9cf80a33f0 2024-04-26T00:50:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf806db70 con 0x7f9cf80a33f0 2024-04-26T00:50:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f9ce8012b50 con 0x7f9cf80a33f0 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 0x7f9cd809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 0x7f9cd809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f9ce80c3160 con 0x7f9cf80a33f0 2024-04-26T00:50:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.024+0000 7f9cf77fe640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 0x7f9cd809b800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ad000 tx=0x7f9ce0004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.028+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9ce8094090 con 0x7f9cf80a33f0 2024-04-26T00:50:43.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cf80a6910 con 0x7f9cf80a33f0 2024-04-26T00:50:43.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cf4ff9640 1 -- 172.21.15.6:0/3421357187 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7f9ce8093990 con 0x7f9cf80a33f0 2024-04-26T00:50:43.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:43.244 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:50:43.244 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 10 mgrc shutdown 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 msgr2=0x7f9cd809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 0x7f9cd809b800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ad000 tx=0x7f9ce0004740 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 msgr2=0x7f9cf8138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800d5f0 tx=0x7f9ce800dab0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 shutdown_connections 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9cd8099340 0x7f9cd809b800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cf8148ed0 0x7f9cf8140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf80a4560 0x7f9cf80b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 --2- 172.21.15.6:0/3421357187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cf80a33f0 0x7f9cf8138f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 >> 172.21.15.6:0/3421357187 conn(0x7f9cf806e230 msgr2=0x7f9cf814ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 shutdown_connections 2024-04-26T00:50:43.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.236+0000 7f9cfe5c1640 1 -- 172.21.15.6:0/3421357187 wait complete. 2024-04-26T00:50:43.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.364+0000 7f06e8630640 1 Processor -- start 2024-04-26T00:50:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.364+0000 7f06e8630640 1 -- start start 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06e00a58b0 0x7f06e00b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 0x7f06e00723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f06e0073240 0x7f06e0071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f06e0072df0 con 0x7f06e00a58b0 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f06e0072b30 con 0x7f06e0073240 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e8630640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00a7f10 con 0x7f06e0138390 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e5bcb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 0x7f06e00723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06e00a58b0 0x7f06e00b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e5bcb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 0x7f06e00723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38950/0 (socket says 172.21.15.6:38950) 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06e00a58b0 0x7f06e00b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38266/0 (socket says 172.21.15.6:38266) 2024-04-26T00:50:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e5bcb640 1 -- 172.21.15.6:0/751005342 learned_addr learned my addr 172.21.15.6:0/751005342 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 -- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 msgr2=0x7f06e00723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 --2- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 0x7f06e00723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 -- 172.21.15.6:0/751005342 >> v2:172.21.15.188:3300/0 conn(0x7f06e0073240 msgr2=0x7f06e0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 --2- 172.21.15.6:0/751005342 >> v2:172.21.15.188:3300/0 conn(0x7f06e0073240 0x7f06e0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.368+0000 7f06e63cc640 1 -- 172.21.15.6:0/751005342 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e00a5c90 con 0x7f06e00a58b0 2024-04-26T00:50:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e63cc640 1 --2- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e00a58b0 0x7f06e00b7530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06e006c730 tx=0x7f06d001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f380596910df244 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e53ca640 1 -- 172.21.15.6:0/751005342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b1070 con 0x7f06e00a58b0 2024-04-26T00:50:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e53ca640 1 -- 172.21.15.6:0/751005342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00ac410 con 0x7f06e00a58b0 2024-04-26T00:50:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e53ca640 1 -- 172.21.15.6:0/751005342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ac7e0 con 0x7f06e00a58b0 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e00a58b0 msgr2=0x7f06e00b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 --2- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e00a58b0 0x7f06e00b7530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06e006c730 tx=0x7f06d001c390 comp rx=0 tx=0).stop 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- 172.21.15.6:0/751005342 shutdown_connections 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 --2- 172.21.15.6:0/751005342 >> v2:172.21.15.188:3300/0 conn(0x7f06e0073240 0x7f06e0071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 --2- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0138390 0x7f06e00723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 --2- 172.21.15.6:0/751005342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e00a58b0 0x7f06e00b7530 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- 172.21.15.6:0/751005342 >> 172.21.15.6:0/751005342 conn(0x7f06e006e230 msgr2=0x7f06e00b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- 172.21.15.6:0/751005342 shutdown_connections 2024-04-26T00:50:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- 172.21.15.6:0/751005342 wait complete. 2024-04-26T00:50:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 Processor -- start 2024-04-26T00:50:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.372+0000 7f06e8630640 1 -- start start 2024-04-26T00:50:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06e00a58b0 0x7f06e012db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0134f10 con 0x7f06e0138390 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0134d90 con 0x7f06e00a58b0 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f06e0135090 con 0x7f06e0073240 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e6bcd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e6bcd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38274/0 (socket says 172.21.15.6:38274) 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e6bcd640 1 -- 172.21.15.6:0/306054899 learned_addr learned my addr 172.21.15.6:0/306054899 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38966/0 (socket says 172.21.15.6:38966) 2024-04-26T00:50:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e5bcb640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06e00a58b0 0x7f06e012db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 -- 172.21.15.6:0/306054899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06e00a58b0 msgr2=0x7f06e012db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06e00a58b0 0x7f06e012db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 -- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 msgr2=0x7f06e012e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 -- 172.21.15.6:0/306054899 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e012d3e0 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e6bcd640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e63cc640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06e006cbd0 tx=0x7f06e0135380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b1040 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00ba070 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e00b2200 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b5650 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e014c2d0 con 0x7f06e0073240 2024-04-26T00:50:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e006db70 con 0x7f06e0073240 2024-04-26T00:50:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f06d00b57f0 con 0x7f06e0073240 2024-04-26T00:50:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.376+0000 7f06d6ffd640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 0x7f06c409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.380+0000 7f06e5bcb640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 0x7f06c409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.380+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f06d015ca40 con 0x7f06e0073240 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.380+0000 7f06e5bcb640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 0x7f06c409b800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06e00a52d0 tx=0x7f06dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.380+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f06d0016010 con 0x7f06e0073240 2024-04-26T00:50:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.536+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06e0136060 con 0x7f06e0073240 2024-04-26T00:50:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06d6ffd640 1 -- 172.21.15.6:0/306054899 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7f06d012d9d0 con 0x7f06e0073240 2024-04-26T00:50:43.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:43.547 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 10 mgrc shutdown 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 msgr2=0x7f06c409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 0x7f06c409b800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06e00a52d0 tx=0x7f06dc008040 comp rx=0 tx=0).stop 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 msgr2=0x7f06e00b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06e006cbd0 tx=0x7f06e0135380 comp rx=0 tx=0).stop 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 shutdown_connections 2024-04-26T00:50:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f06c4099340 0x7f06c409b800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e0138390 0x7f06e012e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06e00a58b0 0x7f06e012db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 --2- 172.21.15.6:0/306054899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06e0073240 0x7f06e00b18a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 >> 172.21.15.6:0/306054899 conn(0x7f06e006e230 msgr2=0x7f06e006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 shutdown_connections 2024-04-26T00:50:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.540+0000 7f06e8630640 1 -- 172.21.15.6:0/306054899 wait complete. 2024-04-26T00:50:43.565 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T00:50:43.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:43.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.676+0000 7f5e4498c640 1 Processor -- start 2024-04-26T00:50:43.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.676+0000 7f5e4498c640 1 -- start start 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e4498c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5e400abd20 0x7f5e401456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e4498c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e4014d7d0 0x7f5e4014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e4498c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e40148870 con 0x7f5e4006c410 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e4498c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4006c7f0 con 0x7f5e4014d7d0 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e4498c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5e40148b30 con 0x7f5e400abd20 2024-04-26T00:50:43.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e4014d7d0 0x7f5e4014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e4006c410 0x7f5e4006f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41130/0 (socket says 172.21.15.6:41130) 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3e59c640 1 -- 172.21.15.6:0/2696547958 learned_addr learned my addr 172.21.15.6:0/2696547958 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/2696547958 >> v2:172.21.15.188:3300/0 conn(0x7f5e400abd20 msgr2=0x7f5e401456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 --2- 172.21.15.6:0/2696547958 >> v2:172.21.15.188:3300/0 conn(0x7f5e400abd20 0x7f5e401456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/2696547958 >> v1:172.21.15.6:6789/0 conn(0x7f5e4006c410 legacy=0x7f5e4006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/2696547958 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e400aaaa0 con 0x7f5e4014d7d0 2024-04-26T00:50:43.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3d59a640 1 -- 172.21.15.6:0/2696547958 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133138712 0 0) 0x7f5e40148870 con 0x7f5e4006c410 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3ed9d640 1 --2- 172.21.15.6:0/2696547958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e4014fbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006cbb0 tx=0x7f5e3801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8053b7f1ef560f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3d59a640 1 -- 172.21.15.6:0/2696547958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e380b5070 con 0x7f5e4014d7d0 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3d59a640 1 -- 172.21.15.6:0/2696547958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e380a8950 con 0x7f5e4014d7d0 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.680+0000 7f5e3d59a640 1 -- 172.21.15.6:0/2696547958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e380a8d20 con 0x7f5e4014d7d0 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/2696547958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 msgr2=0x7f5e4014fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- 172.21.15.6:0/2696547958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e4014fbc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e4006cbb0 tx=0x7f5e3801ec50 comp rx=0 tx=0).stop 2024-04-26T00:50:43.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/2696547958 shutdown_connections 2024-04-26T00:50:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- 172.21.15.6:0/2696547958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e4014fbc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- 172.21.15.6:0/2696547958 >> v2:172.21.15.188:3300/0 conn(0x7f5e400abd20 0x7f5e401456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/2696547958 >> 172.21.15.6:0/2696547958 conn(0x7f5e400bacf0 msgr2=0x7f5e400bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/2696547958 shutdown_connections 2024-04-26T00:50:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/2696547958 wait complete. 2024-04-26T00:50:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 Processor -- start 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- start start 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e400abd20 0x7f5e400b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e401ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40145bf0 con 0x7f5e4014d7d0 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5e400ac7a0 con 0x7f5e400abd20 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5e40071a90 con 0x7f5e4006c410 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3e59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e401ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3e59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38968/0 (socket says 172.21.15.6:38968) 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3e59c640 1 -- 172.21.15.6:0/866972346 learned_addr learned my addr 172.21.15.6:0/866972346 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 msgr2=0x7f5e40072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3dd9b640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e400abd20 0x7f5e400b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/866972346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e400abd20 msgr2=0x7f5e400b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e400abd20 0x7f5e400b9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 -- 172.21.15.6:0/866972346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e40137760 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3e59c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e3ed9d640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e401ddc50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e380af000 tx=0x7f5e3801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e380b5040 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e380c0070 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e401de620 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e380b0a20 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e400b9b50 con 0x7f5e4014d7d0 2024-04-26T00:50:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.684+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4006db70 con 0x7f5e4014d7d0 2024-04-26T00:50:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f5e380b0bc0 con 0x7f5e4014d7d0 2024-04-26T00:50:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 0x7f5e2009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e3e59c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 0x7f5e2009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f5e38160370 con 0x7f5e4014d7d0 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.688+0000 7f5e3e59c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 0x7f5e2009b880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000f70 tx=0x7f5e30007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.692+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5e380187b0 con 0x7f5e4014d7d0 2024-04-26T00:50:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.852+0000 7f5e4498c640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.852+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e400aad00 con 0x7f5e200993c0 2024-04-26T00:50:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.868+0000 7f5e36ffd640 1 -- 172.21.15.6:0/866972346 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255618 (secure 0 0 0) 0x7f5e400aad00 con 0x7f5e200993c0 2024-04-26T00:50:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.868+0000 7f5e36ffd640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:43.877 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 10 mgrc shutdown 2024-04-26T00:50:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 msgr2=0x7f5e2009b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 0x7f5e2009b880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000f70 tx=0x7f5e30007e20 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 msgr2=0x7f5e401ddc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e401ddc50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e380af000 tx=0x7f5e3801b9f0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 shutdown_connections 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5e200993c0 0x7f5e2009b880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4014d7d0 0x7f5e401ddc50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e400abd20 0x7f5e400b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 --2- 172.21.15.6:0/866972346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5e4006c410 0x7f5e40072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 >> 172.21.15.6:0/866972346 conn(0x7f5e400bacf0 msgr2=0x7f5e4006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 shutdown_connections 2024-04-26T00:50:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:43.872+0000 7f5e4498c640 1 -- 172.21.15.6:0/866972346 wait complete. 2024-04-26T00:50:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T00:50:42.243433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113952,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373408,"statfs":{"total":386547056640,"available":386430369792,"internally_reserved":0,"allocated":1744896,"data_stored":1356660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.430840"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698369+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:35.698369+0000","last_peered":"2024-04-26T00:50:35.698369+0000","last_clean":"2024-04-26T00:50:35.698369+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:35.698369+0000","last_undegraded":"2024-04-26T00:50:35.698369+0000","last_fullsized":"2024-04-26T00:50:35.698369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695796+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:35.695796+0000","last_peered":"2024-04-26T00:50:35.695796+0000","last_clean":"2024-04-26T00:50:35.695796+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:35.695796+0000","last_undegraded":"2024-04-26T00:50:35.695796+0000","last_fullsized":"2024-04-26T00:50:35.695796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695687+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:35.695687+0000","last_peered":"2024-04-26T00:50:35.695687+0000","last_clean":"2024-04-26T00:50:35.695687+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:35.695687+0000","last_undegraded":"2024-04-26T00:50:35.695687+0000","last_fullsized":"2024-04-26T00:50:35.695687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:36.693050+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:36.693050+0000","last_peered":"2024-04-26T00:50:36.693050+0000","last_clean":"2024-04-26T00:50:36.693050+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:36.693050+0000","last_undegraded":"2024-04-26T00:50:36.693050+0000","last_fullsized":"2024-04-26T00:50:36.693050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695882+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:35.695882+0000","last_peered":"2024-04-26T00:50:35.695882+0000","last_clean":"2024-04-26T00:50:35.695882+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:35.695882+0000","last_undegraded":"2024-04-26T00:50:35.695882+0000","last_fullsized":"2024-04-26T00:50:35.695882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698585+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:35.698585+0000","last_peered":"2024-04-26T00:50:35.698585+0000","last_clean":"2024-04-26T00:50:35.698585+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:35.698585+0000","last_undegraded":"2024-04-26T00:50:35.698585+0000","last_fullsized":"2024-04-26T00:50:35.698585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695720+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:35.695720+0000","last_peered":"2024-04-26T00:50:35.695720+0000","last_clean":"2024-04-26T00:50:35.695720+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:35.695720+0000","last_undegraded":"2024-04-26T00:50:35.695720+0000","last_fullsized":"2024-04-26T00:50:35.695720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698665+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:35.698665+0000","last_peered":"2024-04-26T00:50:35.698665+0000","last_clean":"2024-04-26T00:50:35.698665+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:35.698665+0000","last_undegraded":"2024-04-26T00:50:35.698665+0000","last_fullsized":"2024-04-26T00:50:35.698665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695879+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:35.695879+0000","last_peered":"2024-04-26T00:50:35.695879+0000","last_clean":"2024-04-26T00:50:35.695879+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:35.695879+0000","last_undegraded":"2024-04-26T00:50:35.695879+0000","last_fullsized":"2024-04-26T00:50:35.695879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":634349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":634349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:43.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.060+0000 7f29c8859640 1 Processor -- start 2024-04-26T00:50:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.060+0000 7f29c8859640 1 -- start start 2024-04-26T00:50:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 0x7f29c40aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c40aabe0 con 0x7f29c41464a0 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f29c4071da0 con 0x7f29c414b820 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f29c40b4770 con 0x7f29c40b4390 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 0x7f29c40aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c1d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f29c41464a0 0x7f29c4072120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41136/0 (socket says 172.21.15.6:41136) 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38308/0 (socket says 172.21.15.6:38308) 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c1d9b640 1 -- 172.21.15.6:0/4275044574 learned_addr learned my addr 172.21.15.6:0/4275044574 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 -- 172.21.15.6:0/4275044574 >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 msgr2=0x7f29c414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 --2- 172.21.15.6:0/4275044574 >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 -- 172.21.15.6:0/4275044574 >> v1:172.21.15.6:6789/0 conn(0x7f29c41464a0 legacy=0x7f29c4072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 -- 172.21.15.6:0/4275044574 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c4072830 con 0x7f29c40b4390 2024-04-26T00:50:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c2d9d640 1 --2- 172.21.15.6:0/4275044574 >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c259c640 1 --2- 172.21.15.6:0/4275044574 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 0x7f29c40aa6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d90 tx=0x7f29bc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929196375df6346e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c159a640 1 -- 172.21.15.6:0/4275044574 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0b2070 con 0x7f29c40b4390 2024-04-26T00:50:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c159a640 1 -- 172.21.15.6:0/4275044574 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a59a0 con 0x7f29c40b4390 2024-04-26T00:50:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c159a640 1 -- 172.21.15.6:0/4275044574 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0a5d70 con 0x7f29c40b4390 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- 172.21.15.6:0/4275044574 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 msgr2=0x7f29c40aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 --2- 172.21.15.6:0/4275044574 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 0x7f29c40aa6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d90 tx=0x7f29bc01c8c0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- 172.21.15.6:0/4275044574 shutdown_connections 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 --2- 172.21.15.6:0/4275044574 >> v2:172.21.15.6:3300/0 conn(0x7f29c414b820 0x7f29c414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 --2- 172.21.15.6:0/4275044574 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c40b4390 0x7f29c40aa6a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- 172.21.15.6:0/4275044574 >> 172.21.15.6:0/4275044574 conn(0x7f29c406e230 msgr2=0x7f29c40b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.064+0000 7f29c8859640 1 -- 172.21.15.6:0/4275044574 shutdown_connections 2024-04-26T00:50:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- 172.21.15.6:0/4275044574 wait complete. 2024-04-26T00:50:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 Processor -- start 2024-04-26T00:50:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- start start 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 0x7f29c413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29c40734e0 con 0x7f29c40b4390 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29c40b7730 con 0x7f29c41464a0 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f29c4150970 con 0x7f29c414b820 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38316/0 (socket says 172.21.15.6:38316) 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38988/0 (socket says 172.21.15.6:38988) 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 -- 172.21.15.6:0/3630441350 learned_addr learned my addr 172.21.15.6:0/3630441350 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c1d9b640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 0x7f29c413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 -- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 msgr2=0x7f29c413b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 -- 172.21.15.6:0/3630441350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 msgr2=0x7f29c413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 0x7f29c413cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 -- 172.21.15.6:0/3630441350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c413c670 con 0x7f29c40b4390 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c2d9d640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c1d9b640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 0x7f29c413cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c259c640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0b0040 tx=0x7f29bc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0b2050 con 0x7f29c40b4390 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc0be070 con 0x7f29c40b4390 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c4143ab0 con 0x7f29c40b4390 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0b9450 con 0x7f29c40b4390 2024-04-26T00:50:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c413ef20 con 0x7f29c40b4390 2024-04-26T00:50:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.068+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c406db70 con 0x7f29c40b4390 2024-04-26T00:50:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f29bc0b95f0 con 0x7f29c40b4390 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 0x7f29a409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29c1d9b640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 0x7f29a409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f29bc15d960 con 0x7f29c40b4390 2024-04-26T00:50:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.072+0000 7f29c1d9b640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 0x7f29a409b800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29c40b6d40 tx=0x7f29ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.076+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f29bc016540 con 0x7f29c40b4390 2024-04-26T00:50:44.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.236+0000 7f29c8859640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.236+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29c4073060 con 0x7f29a4099340 2024-04-26T00:50:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.252+0000 7f29baffd640 1 -- 172.21.15.6:0/3630441350 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255618 (secure 0 0 0) 0x7f29ac001ca0 con 0x7f29a4099340 2024-04-26T00:50:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.252+0000 7f29baffd640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 10 mgrc shutdown 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 msgr2=0x7f29a409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 0x7f29a409b800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29c40b6d40 tx=0x7f29ac009040 comp rx=0 tx=0).stop 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 msgr2=0x7f29c40b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0b0040 tx=0x7f29bc019660 comp rx=0 tx=0).stop 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 shutdown_connections 2024-04-26T00:50:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f29a4099340 0x7f29a409b800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29c414b820 0x7f29c413b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29c41464a0 0x7f29c413cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 --2- 172.21.15.6:0/3630441350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c40b4390 0x7f29c40b6670 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 >> 172.21.15.6:0/3630441350 conn(0x7f29c406e230 msgr2=0x7f29c406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 shutdown_connections 2024-04-26T00:50:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.256+0000 7f29c8859640 1 -- 172.21.15.6:0/3630441350 wait complete. 2024-04-26T00:50:44.279 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T00:50:42.243433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113952,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373408,"statfs":{"total":386547056640,"available":386430369792,"internally_reserved":0,"allocated":1744896,"data_stored":1356660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.430840"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698369+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:35.698369+0000","last_peered":"2024-04-26T00:50:35.698369+0000","last_clean":"2024-04-26T00:50:35.698369+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:35.698369+0000","last_undegraded":"2024-04-26T00:50:35.698369+0000","last_fullsized":"2024-04-26T00:50:35.698369+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695796+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:35.695796+0000","last_peered":"2024-04-26T00:50:35.695796+0000","last_clean":"2024-04-26T00:50:35.695796+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:35.695796+0000","last_undegraded":"2024-04-26T00:50:35.695796+0000","last_fullsized":"2024-04-26T00:50:35.695796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695687+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:35.695687+0000","last_peered":"2024-04-26T00:50:35.695687+0000","last_clean":"2024-04-26T00:50:35.695687+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:35.695687+0000","last_undegraded":"2024-04-26T00:50:35.695687+0000","last_fullsized":"2024-04-26T00:50:35.695687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:36.693050+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:36.693050+0000","last_peered":"2024-04-26T00:50:36.693050+0000","last_clean":"2024-04-26T00:50:36.693050+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:36.693050+0000","last_undegraded":"2024-04-26T00:50:36.693050+0000","last_fullsized":"2024-04-26T00:50:36.693050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695882+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:35.695882+0000","last_peered":"2024-04-26T00:50:35.695882+0000","last_clean":"2024-04-26T00:50:35.695882+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:35.695882+0000","last_undegraded":"2024-04-26T00:50:35.695882+0000","last_fullsized":"2024-04-26T00:50:35.695882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698585+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:35.698585+0000","last_peered":"2024-04-26T00:50:35.698585+0000","last_clean":"2024-04-26T00:50:35.698585+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:35.698585+0000","last_undegraded":"2024-04-26T00:50:35.698585+0000","last_fullsized":"2024-04-26T00:50:35.698585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695720+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:35.695720+0000","last_peered":"2024-04-26T00:50:35.695720+0000","last_clean":"2024-04-26T00:50:35.695720+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:35.695720+0000","last_undegraded":"2024-04-26T00:50:35.695720+0000","last_fullsized":"2024-04-26T00:50:35.695720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.698665+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:35.698665+0000","last_peered":"2024-04-26T00:50:35.698665+0000","last_clean":"2024-04-26T00:50:35.698665+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:35.698665+0000","last_undegraded":"2024-04-26T00:50:35.698665+0000","last_fullsized":"2024-04-26T00:50:35.698665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T00:50:35.695879+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:35.695879+0000","last_peered":"2024-04-26T00:50:35.695879+0000","last_clean":"2024-04-26T00:50:35.695879+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:35.695879+0000","last_undegraded":"2024-04-26T00:50:35.695879+0000","last_fullsized":"2024-04-26T00:50:35.695879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:38.811523+0000","last_change":"2024-04-26T00:50:38.811523+0000","last_active":"2024-04-26T00:50:38.811523+0000","last_peered":"2024-04-26T00:50:38.811523+0000","last_clean":"2024-04-26T00:50:38.811523+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:38.811523+0000","last_undegraded":"2024-04-26T00:50:38.811523+0000","last_fullsized":"2024-04-26T00:50:38.811523+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T00:50:37.807947+0000","last_change":"2024-04-26T00:50:37.807947+0000","last_active":"2024-04-26T00:50:37.807947+0000","last_peered":"2024-04-26T00:50:37.807947+0000","last_clean":"2024-04-26T00:50:37.807947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T00:50:37.807947+0000","last_undegraded":"2024-04-26T00:50:37.807947+0000","last_fullsized":"2024-04-26T00:50:37.807947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":634349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":634349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:44.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 Processor -- start 2024-04-26T00:50:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 -- start start 2024-04-26T00:50:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 0x7fd338071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd338146560 con 0x7fd338142850 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd338146330 con 0x7fd338071890 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33ea80640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd338143c40 con 0x7fd3380723a0 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd337fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 0x7fd338071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd337fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 0x7fd338071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38318/0 (socket says 172.21.15.6:38318) 2024-04-26T00:50:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:39000/0 (socket says 172.21.15.6:39000) 2024-04-26T00:50:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd337fff640 1 -- 172.21.15.6:0/341936040 learned_addr learned my addr 172.21.15.6:0/341936040 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 -- 172.21.15.6:0/341936040 >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 msgr2=0x7fd338071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 --2- 172.21.15.6:0/341936040 >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 0x7fd338071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 -- 172.21.15.6:0/341936040 >> v1:172.21.15.188:6789/0 conn(0x7fd338142850 legacy=0x7fd33806b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 -- 172.21.15.6:0/341936040 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd338146800 con 0x7fd3380723a0 2024-04-26T00:50:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.436+0000 7fd33d01d640 1 --2- 172.21.15.6:0/341936040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd330009d90 tx=0x7fd33001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620d0d42059047e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3377fe640 1 -- 172.21.15.6:0/341936040 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300a6700 con 0x7fd3380723a0 2024-04-26T00:50:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3377fe640 1 -- 172.21.15.6:0/341936040 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3300a68a0 con 0x7fd3380723a0 2024-04-26T00:50:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3377fe640 1 -- 172.21.15.6:0/341936040 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300a6c70 con 0x7fd3380723a0 2024-04-26T00:50:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/341936040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 msgr2=0x7fd33814d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- 172.21.15.6:0/341936040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd330009d90 tx=0x7fd33001c830 comp rx=0 tx=0).stop 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/341936040 shutdown_connections 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- 172.21.15.6:0/341936040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd3380723a0 0x7fd33814d6c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- 172.21.15.6:0/341936040 >> v2:172.21.15.6:3300/0 conn(0x7fd338071890 0x7fd338071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/341936040 >> 172.21.15.6:0/341936040 conn(0x7fd338070210 msgr2=0x7fd338070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/341936040 shutdown_connections 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/341936040 wait complete. 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 Processor -- start 2024-04-26T00:50:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- start start 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd338071890 0x7fd338141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3380723a0 0x7fd33814c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd338150630 con 0x7fd338071890 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd338073450 con 0x7fd3380723a0 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd3381507b0 con 0x7fd338142850 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:39016/0 (socket says 172.21.15.6:39016) 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 -- 172.21.15.6:0/3975904027 learned_addr learned my addr 172.21.15.6:0/3975904027 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33c81c640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd338071890 0x7fd338141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd337fff640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3380723a0 0x7fd33814c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 -- 172.21.15.6:0/3975904027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3380723a0 msgr2=0x7fd33814c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3380723a0 0x7fd33814c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 -- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd338071890 msgr2=0x7fd338141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd338071890 0x7fd338141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 -- 172.21.15.6:0/3975904027 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3381df0a0 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33d01d640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3300b0040 tx=0x7fd3300195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300be070 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3300b8650 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33814bde0 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300b8a40 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.440+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3380b9770 con 0x7fd338142850 2024-04-26T00:50:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33806db70 con 0x7fd338142850 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd3300c1070 con 0x7fd338142850 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 0x7fd31c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd33c81c640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 0x7fd31c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd33015d870 con 0x7fd338142850 2024-04-26T00:50:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.444+0000 7fd33c81c640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 0x7fd31c09b800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.448+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd330016540 con 0x7fd338142850 2024-04-26T00:50:44.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.604+0000 7fd33ea80640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:44.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.604+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3380aad10 con 0x7fd31c099340 2024-04-26T00:50:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.612+0000 7fd3357fa640 1 -- 172.21.15.6:0/3975904027 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268604 (secure 0 0 0) 0x7fd3380aad10 con 0x7fd31c099340 2024-04-26T00:50:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.612+0000 7fd3357fa640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:44.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:44.626 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 10 mgrc shutdown 2024-04-26T00:50:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 msgr2=0x7fd31c09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 0x7fd31c09b800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2024-04-26T00:50:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 msgr2=0x7fd33814a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3300b0040 tx=0x7fd3300195d0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 shutdown_connections 2024-04-26T00:50:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd31c099340 0x7fd31c09b800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd338142850 0x7fd33814a990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3380723a0 0x7fd33814c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 --2- 172.21.15.6:0/3975904027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd338071890 0x7fd338141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.616+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 >> 172.21.15.6:0/3975904027 conn(0x7fd338070210 msgr2=0x7fd3380a91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.620+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 shutdown_connections 2024-04-26T00:50:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.620+0000 7fd33ea80640 1 -- 172.21.15.6:0/3975904027 wait complete. 2024-04-26T00:50:44.643 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T00:50:44.255781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114192,"kb_used_data":1944,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373168,"statfs":{"total":386547056640,"available":386430124032,"internally_reserved":0,"allocated":1990656,"data_stored":1439892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013441"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855209+0000","last_change":"2024-04-26T00:50:39.864060+0000","last_active":"2024-04-26T00:50:40.855209+0000","last_peered":"2024-04-26T00:50:40.855209+0000","last_clean":"2024-04-26T00:50:40.855209+0000","last_became_active":"2024-04-26T00:50:39.863233+0000","last_became_peered":"2024-04-26T00:50:39.863233+0000","last_unstale":"2024-04-26T00:50:40.855209+0000","last_undegraded":"2024-04-26T00:50:40.855209+0000","last_fullsized":"2024-04-26T00:50:40.855209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.858910+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858358+0000","last_became_peered":"2024-04-26T00:50:39.858358+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.333493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.859022+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858634+0000","last_became_peered":"2024-04-26T00:50:39.858634+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:01:18.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464955+0000","last_change":"2024-04-26T00:50:39.861410+0000","last_active":"2024-04-26T00:50:41.464955+0000","last_peered":"2024-04-26T00:50:41.464955+0000","last_clean":"2024-04-26T00:50:41.464955+0000","last_became_active":"2024-04-26T00:50:39.860413+0000","last_became_peered":"2024-04-26T00:50:39.860413+0000","last_unstale":"2024-04-26T00:50:41.464955+0000","last_undegraded":"2024-04-26T00:50:41.464955+0000","last_fullsized":"2024-04-26T00:50:41.464955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465774+0000","last_change":"2024-04-26T00:50:39.854723+0000","last_active":"2024-04-26T00:50:41.465774+0000","last_peered":"2024-04-26T00:50:41.465774+0000","last_clean":"2024-04-26T00:50:41.465774+0000","last_became_active":"2024-04-26T00:50:39.854507+0000","last_became_peered":"2024-04-26T00:50:39.854507+0000","last_unstale":"2024-04-26T00:50:41.465774+0000","last_undegraded":"2024-04-26T00:50:41.465774+0000","last_fullsized":"2024-04-26T00:50:41.465774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:58.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465520+0000","last_change":"2024-04-26T00:50:39.848920+0000","last_active":"2024-04-26T00:50:41.465520+0000","last_peered":"2024-04-26T00:50:41.465520+0000","last_clean":"2024-04-26T00:50:41.465520+0000","last_became_active":"2024-04-26T00:50:39.848576+0000","last_became_peered":"2024-04-26T00:50:39.848576+0000","last_unstale":"2024-04-26T00:50:41.465520+0000","last_undegraded":"2024-04-26T00:50:41.465520+0000","last_fullsized":"2024-04-26T00:50:41.465520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:00.751396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465029+0000","last_change":"2024-04-26T00:50:39.848389+0000","last_active":"2024-04-26T00:50:41.465029+0000","last_peered":"2024-04-26T00:50:41.465029+0000","last_clean":"2024-04-26T00:50:41.465029+0000","last_became_active":"2024-04-26T00:50:39.847874+0000","last_became_peered":"2024-04-26T00:50:39.847874+0000","last_unstale":"2024-04-26T00:50:41.465029+0000","last_undegraded":"2024-04-26T00:50:41.465029+0000","last_fullsized":"2024-04-26T00:50:41.465029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:28.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849307+0000","last_change":"2024-04-26T00:50:39.863022+0000","last_active":"2024-04-26T00:50:40.849307+0000","last_peered":"2024-04-26T00:50:40.849307+0000","last_clean":"2024-04-26T00:50:40.849307+0000","last_became_active":"2024-04-26T00:50:39.862653+0000","last_became_peered":"2024-04-26T00:50:39.862653+0000","last_unstale":"2024-04-26T00:50:40.849307+0000","last_undegraded":"2024-04-26T00:50:40.849307+0000","last_fullsized":"2024-04-26T00:50:40.849307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855363+0000","last_change":"2024-04-26T00:50:39.864364+0000","last_active":"2024-04-26T00:50:40.855363+0000","last_peered":"2024-04-26T00:50:40.855363+0000","last_clean":"2024-04-26T00:50:40.855363+0000","last_became_active":"2024-04-26T00:50:39.863765+0000","last_became_peered":"2024-04-26T00:50:39.863765+0000","last_unstale":"2024-04-26T00:50:40.855363+0000","last_undegraded":"2024-04-26T00:50:40.855363+0000","last_fullsized":"2024-04-26T00:50:40.855363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:03.262591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468765+0000","last_change":"2024-04-26T00:50:39.860856+0000","last_active":"2024-04-26T00:50:41.468765+0000","last_peered":"2024-04-26T00:50:41.468765+0000","last_clean":"2024-04-26T00:50:41.468765+0000","last_became_active":"2024-04-26T00:50:39.860592+0000","last_became_peered":"2024-04-26T00:50:39.860592+0000","last_unstale":"2024-04-26T00:50:41.468765+0000","last_undegraded":"2024-04-26T00:50:41.468765+0000","last_fullsized":"2024-04-26T00:50:41.468765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468466+0000","last_change":"2024-04-26T00:50:39.854576+0000","last_active":"2024-04-26T00:50:41.468466+0000","last_peered":"2024-04-26T00:50:41.468466+0000","last_clean":"2024-04-26T00:50:41.468466+0000","last_became_active":"2024-04-26T00:50:39.854290+0000","last_became_peered":"2024-04-26T00:50:39.854290+0000","last_unstale":"2024-04-26T00:50:41.468466+0000","last_undegraded":"2024-04-26T00:50:41.468466+0000","last_fullsized":"2024-04-26T00:50:41.468466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855221+0000","last_change":"2024-04-26T00:50:39.867495+0000","last_active":"2024-04-26T00:50:40.855221+0000","last_peered":"2024-04-26T00:50:40.855221+0000","last_clean":"2024-04-26T00:50:40.855221+0000","last_became_active":"2024-04-26T00:50:39.866525+0000","last_became_peered":"2024-04-26T00:50:39.866525+0000","last_unstale":"2024-04-26T00:50:40.855221+0000","last_undegraded":"2024-04-26T00:50:40.855221+0000","last_fullsized":"2024-04-26T00:50:40.855221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854314+0000","last_change":"2024-04-26T00:50:39.866036+0000","last_active":"2024-04-26T00:50:40.854314+0000","last_peered":"2024-04-26T00:50:40.854314+0000","last_clean":"2024-04-26T00:50:40.854314+0000","last_became_active":"2024-04-26T00:50:39.864772+0000","last_became_peered":"2024-04-26T00:50:39.864772+0000","last_unstale":"2024-04-26T00:50:40.854314+0000","last_undegraded":"2024-04-26T00:50:40.854314+0000","last_fullsized":"2024-04-26T00:50:40.854314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:20.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850148+0000","last_change":"2024-04-26T00:50:39.850402+0000","last_active":"2024-04-26T00:50:40.850148+0000","last_peered":"2024-04-26T00:50:40.850148+0000","last_clean":"2024-04-26T00:50:40.850148+0000","last_became_active":"2024-04-26T00:50:39.849824+0000","last_became_peered":"2024-04-26T00:50:39.849824+0000","last_unstale":"2024-04-26T00:50:40.850148+0000","last_undegraded":"2024-04-26T00:50:40.850148+0000","last_fullsized":"2024-04-26T00:50:40.850148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849803+0000","last_change":"2024-04-26T00:50:39.859504+0000","last_active":"2024-04-26T00:50:40.849803+0000","last_peered":"2024-04-26T00:50:40.849803+0000","last_clean":"2024-04-26T00:50:40.849803+0000","last_became_active":"2024-04-26T00:50:39.858895+0000","last_became_peered":"2024-04-26T00:50:39.858895+0000","last_unstale":"2024-04-26T00:50:40.849803+0000","last_undegraded":"2024-04-26T00:50:40.849803+0000","last_fullsized":"2024-04-26T00:50:40.849803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849230+0000","last_change":"2024-04-26T00:50:39.862674+0000","last_active":"2024-04-26T00:50:40.849230+0000","last_peered":"2024-04-26T00:50:40.849230+0000","last_clean":"2024-04-26T00:50:40.849230+0000","last_became_active":"2024-04-26T00:50:39.862064+0000","last_became_peered":"2024-04-26T00:50:39.862064+0000","last_unstale":"2024-04-26T00:50:40.849230+0000","last_undegraded":"2024-04-26T00:50:40.849230+0000","last_fullsized":"2024-04-26T00:50:40.849230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469383+0000","last_change":"2024-04-26T00:50:39.868719+0000","last_active":"2024-04-26T00:50:41.469383+0000","last_peered":"2024-04-26T00:50:41.469383+0000","last_clean":"2024-04-26T00:50:41.469383+0000","last_became_active":"2024-04-26T00:50:39.868234+0000","last_became_peered":"2024-04-26T00:50:39.868234+0000","last_unstale":"2024-04-26T00:50:41.469383+0000","last_undegraded":"2024-04-26T00:50:41.469383+0000","last_fullsized":"2024-04-26T00:50:41.469383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467114+0000","last_change":"2024-04-26T00:50:39.864259+0000","last_active":"2024-04-26T00:50:41.467114+0000","last_peered":"2024-04-26T00:50:41.467114+0000","last_clean":"2024-04-26T00:50:41.467114+0000","last_became_active":"2024-04-26T00:50:39.863983+0000","last_became_peered":"2024-04-26T00:50:39.863983+0000","last_unstale":"2024-04-26T00:50:41.467114+0000","last_undegraded":"2024-04-26T00:50:41.467114+0000","last_fullsized":"2024-04-26T00:50:41.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854744+0000","last_change":"2024-04-26T00:50:39.865590+0000","last_active":"2024-04-26T00:50:40.854744+0000","last_peered":"2024-04-26T00:50:40.854744+0000","last_clean":"2024-04-26T00:50:40.854744+0000","last_became_active":"2024-04-26T00:50:39.865319+0000","last_became_peered":"2024-04-26T00:50:39.865319+0000","last_unstale":"2024-04-26T00:50:40.854744+0000","last_undegraded":"2024-04-26T00:50:40.854744+0000","last_fullsized":"2024-04-26T00:50:40.854744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:20.997241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467605+0000","last_change":"2024-04-26T00:50:39.856108+0000","last_active":"2024-04-26T00:50:41.467605+0000","last_peered":"2024-04-26T00:50:41.467605+0000","last_clean":"2024-04-26T00:50:41.467605+0000","last_became_active":"2024-04-26T00:50:39.855807+0000","last_became_peered":"2024-04-26T00:50:39.855807+0000","last_unstale":"2024-04-26T00:50:41.467605+0000","last_undegraded":"2024-04-26T00:50:41.467605+0000","last_fullsized":"2024-04-26T00:50:41.467605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850863+0000","last_change":"2024-04-26T00:50:39.843134+0000","last_active":"2024-04-26T00:50:40.850863+0000","last_peered":"2024-04-26T00:50:40.850863+0000","last_clean":"2024-04-26T00:50:40.850863+0000","last_became_active":"2024-04-26T00:50:39.842326+0000","last_became_peered":"2024-04-26T00:50:39.842326+0000","last_unstale":"2024-04-26T00:50:40.850863+0000","last_undegraded":"2024-04-26T00:50:40.850863+0000","last_fullsized":"2024-04-26T00:50:40.850863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:10:05.591117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464540+0000","last_change":"2024-04-26T00:50:39.854346+0000","last_active":"2024-04-26T00:50:41.464540+0000","last_peered":"2024-04-26T00:50:41.464540+0000","last_clean":"2024-04-26T00:50:41.464540+0000","last_became_active":"2024-04-26T00:50:39.854039+0000","last_became_peered":"2024-04-26T00:50:39.854039+0000","last_unstale":"2024-04-26T00:50:41.464540+0000","last_undegraded":"2024-04-26T00:50:41.464540+0000","last_fullsized":"2024-04-26T00:50:41.464540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465787+0000","last_change":"2024-04-26T00:50:39.860520+0000","last_active":"2024-04-26T00:50:41.465787+0000","last_peered":"2024-04-26T00:50:41.465787+0000","last_clean":"2024-04-26T00:50:41.465787+0000","last_became_active":"2024-04-26T00:50:39.859357+0000","last_became_peered":"2024-04-26T00:50:39.859357+0000","last_unstale":"2024-04-26T00:50:41.465787+0000","last_undegraded":"2024-04-26T00:50:41.465787+0000","last_fullsized":"2024-04-26T00:50:41.465787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849398+0000","last_change":"2024-04-26T00:50:39.858882+0000","last_active":"2024-04-26T00:50:40.849398+0000","last_peered":"2024-04-26T00:50:40.849398+0000","last_clean":"2024-04-26T00:50:40.849398+0000","last_became_active":"2024-04-26T00:50:39.858565+0000","last_became_peered":"2024-04-26T00:50:39.858565+0000","last_unstale":"2024-04-26T00:50:40.849398+0000","last_undegraded":"2024-04-26T00:50:40.849398+0000","last_fullsized":"2024-04-26T00:50:40.849398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468918+0000","last_change":"2024-04-26T00:50:39.857963+0000","last_active":"2024-04-26T00:50:41.468918+0000","last_peered":"2024-04-26T00:50:41.468918+0000","last_clean":"2024-04-26T00:50:41.468918+0000","last_became_active":"2024-04-26T00:50:39.857599+0000","last_became_peered":"2024-04-26T00:50:39.857599+0000","last_unstale":"2024-04-26T00:50:41.468918+0000","last_undegraded":"2024-04-26T00:50:41.468918+0000","last_fullsized":"2024-04-26T00:50:41.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469225+0000","last_change":"2024-04-26T00:50:39.863645+0000","last_active":"2024-04-26T00:50:41.469225+0000","last_peered":"2024-04-26T00:50:41.469225+0000","last_clean":"2024-04-26T00:50:41.469225+0000","last_became_active":"2024-04-26T00:50:39.863391+0000","last_became_peered":"2024-04-26T00:50:39.863391+0000","last_unstale":"2024-04-26T00:50:41.469225+0000","last_undegraded":"2024-04-26T00:50:41.469225+0000","last_fullsized":"2024-04-26T00:50:41.469225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852851+0000","last_change":"2024-04-26T00:50:39.860126+0000","last_active":"2024-04-26T00:50:40.852851+0000","last_peered":"2024-04-26T00:50:40.852851+0000","last_clean":"2024-04-26T00:50:40.852851+0000","last_became_active":"2024-04-26T00:50:39.859701+0000","last_became_peered":"2024-04-26T00:50:39.859701+0000","last_unstale":"2024-04-26T00:50:40.852851+0000","last_undegraded":"2024-04-26T00:50:40.852851+0000","last_fullsized":"2024-04-26T00:50:40.852851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:26:07.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468277+0000","last_change":"2024-04-26T00:50:39.868579+0000","last_active":"2024-04-26T00:50:41.468277+0000","last_peered":"2024-04-26T00:50:41.468277+0000","last_clean":"2024-04-26T00:50:41.468277+0000","last_became_active":"2024-04-26T00:50:39.868213+0000","last_became_peered":"2024-04-26T00:50:39.868213+0000","last_unstale":"2024-04-26T00:50:41.468277+0000","last_undegraded":"2024-04-26T00:50:41.468277+0000","last_fullsized":"2024-04-26T00:50:41.468277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465290+0000","last_change":"2024-04-26T00:50:39.855232+0000","last_active":"2024-04-26T00:50:41.465290+0000","last_peered":"2024-04-26T00:50:41.465290+0000","last_clean":"2024-04-26T00:50:41.465290+0000","last_became_active":"2024-04-26T00:50:39.852449+0000","last_became_peered":"2024-04-26T00:50:39.852449+0000","last_unstale":"2024-04-26T00:50:41.465290+0000","last_undegraded":"2024-04-26T00:50:41.465290+0000","last_fullsized":"2024-04-26T00:50:41.465290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:10.850384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465536+0000","last_change":"2024-04-26T00:50:39.852258+0000","last_active":"2024-04-26T00:50:41.465536+0000","last_peered":"2024-04-26T00:50:41.465536+0000","last_clean":"2024-04-26T00:50:41.465536+0000","last_became_active":"2024-04-26T00:50:39.851730+0000","last_became_peered":"2024-04-26T00:50:39.851730+0000","last_unstale":"2024-04-26T00:50:41.465536+0000","last_undegraded":"2024-04-26T00:50:41.465536+0000","last_fullsized":"2024-04-26T00:50:41.465536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465455+0000","last_change":"2024-04-26T00:50:39.848331+0000","last_active":"2024-04-26T00:50:41.465455+0000","last_peered":"2024-04-26T00:50:41.465455+0000","last_clean":"2024-04-26T00:50:41.465455+0000","last_became_active":"2024-04-26T00:50:39.848027+0000","last_became_peered":"2024-04-26T00:50:39.848027+0000","last_unstale":"2024-04-26T00:50:41.465455+0000","last_undegraded":"2024-04-26T00:50:41.465455+0000","last_fullsized":"2024-04-26T00:50:41.465455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:10.545861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849646+0000","last_change":"2024-04-26T00:50:39.862385+0000","last_active":"2024-04-26T00:50:40.849646+0000","last_peered":"2024-04-26T00:50:40.849646+0000","last_clean":"2024-04-26T00:50:40.849646+0000","last_became_active":"2024-04-26T00:50:39.861979+0000","last_became_peered":"2024-04-26T00:50:39.861979+0000","last_unstale":"2024-04-26T00:50:40.849646+0000","last_undegraded":"2024-04-26T00:50:40.849646+0000","last_fullsized":"2024-04-26T00:50:40.849646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465788+0000","last_change":"2024-04-26T00:50:39.857971+0000","last_active":"2024-04-26T00:50:41.465788+0000","last_peered":"2024-04-26T00:50:41.465788+0000","last_clean":"2024-04-26T00:50:41.465788+0000","last_became_active":"2024-04-26T00:50:39.857706+0000","last_became_peered":"2024-04-26T00:50:39.857706+0000","last_unstale":"2024-04-26T00:50:41.465788+0000","last_undegraded":"2024-04-26T00:50:41.465788+0000","last_fullsized":"2024-04-26T00:50:41.465788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466603+0000","last_change":"2024-04-26T00:50:38.870203+0000","last_active":"2024-04-26T00:50:41.466603+0000","last_peered":"2024-04-26T00:50:41.466603+0000","last_clean":"2024-04-26T00:50:41.466603+0000","last_became_active":"2024-04-26T00:50:38.869667+0000","last_became_peered":"2024-04-26T00:50:38.869667+0000","last_unstale":"2024-04-26T00:50:41.466603+0000","last_undegraded":"2024-04-26T00:50:41.466603+0000","last_fullsized":"2024-04-26T00:50:41.466603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.946855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466766+0000","last_change":"2024-04-26T00:50:39.851780+0000","last_active":"2024-04-26T00:50:41.466766+0000","last_peered":"2024-04-26T00:50:41.466766+0000","last_clean":"2024-04-26T00:50:41.466766+0000","last_became_active":"2024-04-26T00:50:39.851487+0000","last_became_peered":"2024-04-26T00:50:39.851487+0000","last_unstale":"2024-04-26T00:50:41.466766+0000","last_undegraded":"2024-04-26T00:50:41.466766+0000","last_fullsized":"2024-04-26T00:50:41.466766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854350+0000","last_change":"2024-04-26T00:50:38.858405+0000","last_active":"2024-04-26T00:50:40.854350+0000","last_peered":"2024-04-26T00:50:40.854350+0000","last_clean":"2024-04-26T00:50:40.854350+0000","last_became_active":"2024-04-26T00:50:38.857294+0000","last_became_peered":"2024-04-26T00:50:38.857294+0000","last_unstale":"2024-04-26T00:50:40.854350+0000","last_undegraded":"2024-04-26T00:50:40.854350+0000","last_fullsized":"2024-04-26T00:50:40.854350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.943770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466331+0000","last_change":"2024-04-26T00:50:39.854371+0000","last_active":"2024-04-26T00:50:41.466331+0000","last_peered":"2024-04-26T00:50:41.466331+0000","last_clean":"2024-04-26T00:50:41.466331+0000","last_became_active":"2024-04-26T00:50:39.851258+0000","last_became_peered":"2024-04-26T00:50:39.851258+0000","last_unstale":"2024-04-26T00:50:41.466331+0000","last_undegraded":"2024-04-26T00:50:41.466331+0000","last_fullsized":"2024-04-26T00:50:41.466331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850071+0000","last_change":"2024-04-26T00:50:38.855662+0000","last_active":"2024-04-26T00:50:40.850071+0000","last_peered":"2024-04-26T00:50:40.850071+0000","last_clean":"2024-04-26T00:50:40.850071+0000","last_became_active":"2024-04-26T00:50:38.855264+0000","last_became_peered":"2024-04-26T00:50:38.855264+0000","last_unstale":"2024-04-26T00:50:40.850071+0000","last_undegraded":"2024-04-26T00:50:40.850071+0000","last_fullsized":"2024-04-26T00:50:40.850071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:54.888616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468580+0000","last_change":"2024-04-26T00:50:39.860246+0000","last_active":"2024-04-26T00:50:41.468580+0000","last_peered":"2024-04-26T00:50:41.468580+0000","last_clean":"2024-04-26T00:50:41.468580+0000","last_became_active":"2024-04-26T00:50:39.859961+0000","last_became_peered":"2024-04-26T00:50:39.859961+0000","last_unstale":"2024-04-26T00:50:41.468580+0000","last_undegraded":"2024-04-26T00:50:41.468580+0000","last_fullsized":"2024-04-26T00:50:41.468580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849532+0000","last_change":"2024-04-26T00:50:38.858626+0000","last_active":"2024-04-26T00:50:40.849532+0000","last_peered":"2024-04-26T00:50:40.849532+0000","last_clean":"2024-04-26T00:50:40.849532+0000","last_became_active":"2024-04-26T00:50:38.858137+0000","last_became_peered":"2024-04-26T00:50:38.858137+0000","last_unstale":"2024-04-26T00:50:40.849532+0000","last_undegraded":"2024-04-26T00:50:40.849532+0000","last_fullsized":"2024-04-26T00:50:40.849532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:38.523333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852229+0000","last_change":"2024-04-26T00:50:38.873856+0000","last_active":"2024-04-26T00:50:40.852229+0000","last_peered":"2024-04-26T00:50:40.852229+0000","last_clean":"2024-04-26T00:50:40.852229+0000","last_became_active":"2024-04-26T00:50:38.873335+0000","last_became_peered":"2024-04-26T00:50:38.873335+0000","last_unstale":"2024-04-26T00:50:40.852229+0000","last_undegraded":"2024-04-26T00:50:40.852229+0000","last_fullsized":"2024-04-26T00:50:40.852229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:50.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465911+0000","last_change":"2024-04-26T00:50:39.848253+0000","last_active":"2024-04-26T00:50:41.465911+0000","last_peered":"2024-04-26T00:50:41.465911+0000","last_clean":"2024-04-26T00:50:41.465911+0000","last_became_active":"2024-04-26T00:50:39.847884+0000","last_became_peered":"2024-04-26T00:50:39.847884+0000","last_unstale":"2024-04-26T00:50:41.465911+0000","last_undegraded":"2024-04-26T00:50:41.465911+0000","last_fullsized":"2024-04-26T00:50:41.465911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851684+0000","last_change":"2024-04-26T00:50:38.845913+0000","last_active":"2024-04-26T00:50:40.851684+0000","last_peered":"2024-04-26T00:50:40.851684+0000","last_clean":"2024-04-26T00:50:40.851684+0000","last_became_active":"2024-04-26T00:50:38.845248+0000","last_became_peered":"2024-04-26T00:50:38.845248+0000","last_unstale":"2024-04-26T00:50:40.851684+0000","last_undegraded":"2024-04-26T00:50:40.851684+0000","last_fullsized":"2024-04-26T00:50:40.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:01:14.839151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465102+0000","last_change":"2024-04-26T00:50:39.862106+0000","last_active":"2024-04-26T00:50:41.465102+0000","last_peered":"2024-04-26T00:50:41.465102+0000","last_clean":"2024-04-26T00:50:41.465102+0000","last_became_active":"2024-04-26T00:50:39.861838+0000","last_became_peered":"2024-04-26T00:50:39.861838+0000","last_unstale":"2024-04-26T00:50:41.465102+0000","last_undegraded":"2024-04-26T00:50:41.465102+0000","last_fullsized":"2024-04-26T00:50:41.465102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852430+0000","last_change":"2024-04-26T00:50:38.869341+0000","last_active":"2024-04-26T00:50:40.852430+0000","last_peered":"2024-04-26T00:50:40.852430+0000","last_clean":"2024-04-26T00:50:40.852430+0000","last_became_active":"2024-04-26T00:50:38.868538+0000","last_became_peered":"2024-04-26T00:50:38.868538+0000","last_unstale":"2024-04-26T00:50:40.852430+0000","last_undegraded":"2024-04-26T00:50:40.852430+0000","last_fullsized":"2024-04-26T00:50:40.852430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:09.233129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850440+0000","last_change":"2024-04-26T00:50:39.838874+0000","last_active":"2024-04-26T00:50:40.850440+0000","last_peered":"2024-04-26T00:50:40.850440+0000","last_clean":"2024-04-26T00:50:40.850440+0000","last_became_active":"2024-04-26T00:50:39.838130+0000","last_became_peered":"2024-04-26T00:50:39.838130+0000","last_unstale":"2024-04-26T00:50:40.850440+0000","last_undegraded":"2024-04-26T00:50:40.850440+0000","last_fullsized":"2024-04-26T00:50:40.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851387+0000","last_change":"2024-04-26T00:50:38.852912+0000","last_active":"2024-04-26T00:50:40.851387+0000","last_peered":"2024-04-26T00:50:40.851387+0000","last_clean":"2024-04-26T00:50:40.851387+0000","last_became_active":"2024-04-26T00:50:38.852425+0000","last_became_peered":"2024-04-26T00:50:38.852425+0000","last_unstale":"2024-04-26T00:50:40.851387+0000","last_undegraded":"2024-04-26T00:50:40.851387+0000","last_fullsized":"2024-04-26T00:50:40.851387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:26.487714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854707+0000","last_change":"2024-04-26T00:50:39.858386+0000","last_active":"2024-04-26T00:50:40.854707+0000","last_peered":"2024-04-26T00:50:40.854707+0000","last_clean":"2024-04-26T00:50:40.854707+0000","last_became_active":"2024-04-26T00:50:39.858084+0000","last_became_peered":"2024-04-26T00:50:39.858084+0000","last_unstale":"2024-04-26T00:50:40.854707+0000","last_undegraded":"2024-04-26T00:50:40.854707+0000","last_fullsized":"2024-04-26T00:50:40.854707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:24.695303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466946+0000","last_change":"2024-04-26T00:50:38.876499+0000","last_active":"2024-04-26T00:50:41.466946+0000","last_peered":"2024-04-26T00:50:41.466946+0000","last_clean":"2024-04-26T00:50:41.466946+0000","last_became_active":"2024-04-26T00:50:38.875568+0000","last_became_peered":"2024-04-26T00:50:38.875568+0000","last_unstale":"2024-04-26T00:50:41.466946+0000","last_undegraded":"2024-04-26T00:50:41.466946+0000","last_fullsized":"2024-04-26T00:50:41.466946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:08.851681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467684+0000","last_change":"2024-04-26T00:50:39.861634+0000","last_active":"2024-04-26T00:50:41.467684+0000","last_peered":"2024-04-26T00:50:41.467684+0000","last_clean":"2024-04-26T00:50:41.467684+0000","last_became_active":"2024-04-26T00:50:39.860919+0000","last_became_peered":"2024-04-26T00:50:39.860919+0000","last_unstale":"2024-04-26T00:50:41.467684+0000","last_undegraded":"2024-04-26T00:50:41.467684+0000","last_fullsized":"2024-04-26T00:50:41.467684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:38.858272+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:38.857911+0000","last_became_peered":"2024-04-26T00:50:38.857911+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:02.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851832+0000","last_change":"2024-04-26T00:50:39.855731+0000","last_active":"2024-04-26T00:50:40.851832+0000","last_peered":"2024-04-26T00:50:40.851832+0000","last_clean":"2024-04-26T00:50:40.851832+0000","last_became_active":"2024-04-26T00:50:39.855401+0000","last_became_peered":"2024-04-26T00:50:39.855401+0000","last_unstale":"2024-04-26T00:50:40.851832+0000","last_undegraded":"2024-04-26T00:50:40.851832+0000","last_fullsized":"2024-04-26T00:50:40.851832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:05.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466079+0000","last_change":"2024-04-26T00:50:38.876014+0000","last_active":"2024-04-26T00:50:41.466079+0000","last_peered":"2024-04-26T00:50:41.466079+0000","last_clean":"2024-04-26T00:50:41.466079+0000","last_became_active":"2024-04-26T00:50:38.875346+0000","last_became_peered":"2024-04-26T00:50:38.875346+0000","last_unstale":"2024-04-26T00:50:41.466079+0000","last_undegraded":"2024-04-26T00:50:41.466079+0000","last_fullsized":"2024-04-26T00:50:41.466079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:25.084153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855287+0000","last_change":"2024-04-26T00:50:39.852334+0000","last_active":"2024-04-26T00:50:40.855287+0000","last_peered":"2024-04-26T00:50:40.855287+0000","last_clean":"2024-04-26T00:50:40.855287+0000","last_became_active":"2024-04-26T00:50:39.849126+0000","last_became_peered":"2024-04-26T00:50:39.849126+0000","last_unstale":"2024-04-26T00:50:40.855287+0000","last_undegraded":"2024-04-26T00:50:40.855287+0000","last_fullsized":"2024-04-26T00:50:40.855287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:55.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464952+0000","last_change":"2024-04-26T00:50:38.879815+0000","last_active":"2024-04-26T00:50:41.464952+0000","last_peered":"2024-04-26T00:50:41.464952+0000","last_clean":"2024-04-26T00:50:41.464952+0000","last_became_active":"2024-04-26T00:50:38.876392+0000","last_became_peered":"2024-04-26T00:50:38.876392+0000","last_unstale":"2024-04-26T00:50:41.464952+0000","last_undegraded":"2024-04-26T00:50:41.464952+0000","last_fullsized":"2024-04-26T00:50:41.464952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:07.680535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469056+0000","last_change":"2024-04-26T00:50:39.862953+0000","last_active":"2024-04-26T00:50:41.469056+0000","last_peered":"2024-04-26T00:50:41.469056+0000","last_clean":"2024-04-26T00:50:41.469056+0000","last_became_active":"2024-04-26T00:50:39.862133+0000","last_became_peered":"2024-04-26T00:50:39.862133+0000","last_unstale":"2024-04-26T00:50:41.469056+0000","last_undegraded":"2024-04-26T00:50:41.469056+0000","last_fullsized":"2024-04-26T00:50:41.469056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464665+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:41.464665+0000","last_peered":"2024-04-26T00:50:41.464665+0000","last_clean":"2024-04-26T00:50:41.464665+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:41.464665+0000","last_undegraded":"2024-04-26T00:50:41.464665+0000","last_fullsized":"2024-04-26T00:50:41.464665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851020+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:40.851020+0000","last_peered":"2024-04-26T00:50:40.851020+0000","last_clean":"2024-04-26T00:50:40.851020+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:40.851020+0000","last_undegraded":"2024-04-26T00:50:40.851020+0000","last_fullsized":"2024-04-26T00:50:40.851020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467042+0000","last_change":"2024-04-26T00:50:38.866703+0000","last_active":"2024-04-26T00:50:41.467042+0000","last_peered":"2024-04-26T00:50:41.467042+0000","last_clean":"2024-04-26T00:50:41.467042+0000","last_became_active":"2024-04-26T00:50:38.866123+0000","last_became_peered":"2024-04-26T00:50:38.866123+0000","last_unstale":"2024-04-26T00:50:41.467042+0000","last_undegraded":"2024-04-26T00:50:41.467042+0000","last_fullsized":"2024-04-26T00:50:41.467042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:09.927849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852406+0000","last_change":"2024-04-26T00:50:39.859004+0000","last_active":"2024-04-26T00:50:40.852406+0000","last_peered":"2024-04-26T00:50:40.852406+0000","last_clean":"2024-04-26T00:50:40.852406+0000","last_became_active":"2024-04-26T00:50:39.858536+0000","last_became_peered":"2024-04-26T00:50:39.858536+0000","last_unstale":"2024-04-26T00:50:40.852406+0000","last_undegraded":"2024-04-26T00:50:40.852406+0000","last_fullsized":"2024-04-26T00:50:40.852406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:44.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849761+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:40.849761+0000","last_peered":"2024-04-26T00:50:40.849761+0000","last_clean":"2024-04-26T00:50:40.849761+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:40.849761+0000","last_undegraded":"2024-04-26T00:50:40.849761+0000","last_fullsized":"2024-04-26T00:50:40.849761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465609+0000","last_change":"2024-04-26T00:50:38.862050+0000","last_active":"2024-04-26T00:50:41.465609+0000","last_peered":"2024-04-26T00:50:41.465609+0000","last_clean":"2024-04-26T00:50:41.465609+0000","last_became_active":"2024-04-26T00:50:38.861329+0000","last_became_peered":"2024-04-26T00:50:38.861329+0000","last_unstale":"2024-04-26T00:50:41.465609+0000","last_undegraded":"2024-04-26T00:50:41.465609+0000","last_fullsized":"2024-04-26T00:50:41.465609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:19.670169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466871+0000","last_change":"2024-04-26T00:50:39.859556+0000","last_active":"2024-04-26T00:50:41.466871+0000","last_peered":"2024-04-26T00:50:41.466871+0000","last_clean":"2024-04-26T00:50:41.466871+0000","last_became_active":"2024-04-26T00:50:39.858347+0000","last_became_peered":"2024-04-26T00:50:39.858347+0000","last_unstale":"2024-04-26T00:50:41.466871+0000","last_undegraded":"2024-04-26T00:50:41.466871+0000","last_fullsized":"2024-04-26T00:50:41.466871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854116+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:40.854116+0000","last_peered":"2024-04-26T00:50:40.854116+0000","last_clean":"2024-04-26T00:50:40.854116+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:40.854116+0000","last_undegraded":"2024-04-26T00:50:40.854116+0000","last_fullsized":"2024-04-26T00:50:40.854116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464225+0000","last_change":"2024-04-26T00:50:38.864670+0000","last_active":"2024-04-26T00:50:41.464225+0000","last_peered":"2024-04-26T00:50:41.464225+0000","last_clean":"2024-04-26T00:50:41.464225+0000","last_became_active":"2024-04-26T00:50:38.861543+0000","last_became_peered":"2024-04-26T00:50:38.861543+0000","last_unstale":"2024-04-26T00:50:41.464225+0000","last_undegraded":"2024-04-26T00:50:41.464225+0000","last_fullsized":"2024-04-26T00:50:41.464225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469153+0000","last_change":"2024-04-26T00:50:39.862379+0000","last_active":"2024-04-26T00:50:41.469153+0000","last_peered":"2024-04-26T00:50:41.469153+0000","last_clean":"2024-04-26T00:50:41.469153+0000","last_became_active":"2024-04-26T00:50:39.860598+0000","last_became_peered":"2024-04-26T00:50:39.860598+0000","last_unstale":"2024-04-26T00:50:41.469153+0000","last_undegraded":"2024-04-26T00:50:41.469153+0000","last_fullsized":"2024-04-26T00:50:41.469153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850966+0000","last_change":"2024-04-26T00:50:38.857970+0000","last_active":"2024-04-26T00:50:40.850966+0000","last_peered":"2024-04-26T00:50:40.850966+0000","last_clean":"2024-04-26T00:50:40.850966+0000","last_became_active":"2024-04-26T00:50:38.857664+0000","last_became_peered":"2024-04-26T00:50:38.857664+0000","last_unstale":"2024-04-26T00:50:40.850966+0000","last_undegraded":"2024-04-26T00:50:40.850966+0000","last_fullsized":"2024-04-26T00:50:40.850966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.406470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467834+0000","last_change":"2024-04-26T00:50:39.868652+0000","last_active":"2024-04-26T00:50:41.467834+0000","last_peered":"2024-04-26T00:50:41.467834+0000","last_clean":"2024-04-26T00:50:41.467834+0000","last_became_active":"2024-04-26T00:50:39.868244+0000","last_became_peered":"2024-04-26T00:50:39.868244+0000","last_unstale":"2024-04-26T00:50:41.467834+0000","last_undegraded":"2024-04-26T00:50:41.467834+0000","last_fullsized":"2024-04-26T00:50:41.467834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852702+0000","last_change":"2024-04-26T00:50:38.868988+0000","last_active":"2024-04-26T00:50:40.852702+0000","last_peered":"2024-04-26T00:50:40.852702+0000","last_clean":"2024-04-26T00:50:40.852702+0000","last_became_active":"2024-04-26T00:50:38.868419+0000","last_became_peered":"2024-04-26T00:50:38.868419+0000","last_unstale":"2024-04-26T00:50:40.852702+0000","last_undegraded":"2024-04-26T00:50:40.852702+0000","last_fullsized":"2024-04-26T00:50:40.852702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.246593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468295+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:41.468295+0000","last_peered":"2024-04-26T00:50:41.468295+0000","last_clean":"2024-04-26T00:50:41.468295+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:41.468295+0000","last_undegraded":"2024-04-26T00:50:41.468295+0000","last_fullsized":"2024-04-26T00:50:41.468295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464953+0000","last_change":"2024-04-26T00:50:39.855312+0000","last_active":"2024-04-26T00:50:41.464953+0000","last_peered":"2024-04-26T00:50:41.464953+0000","last_clean":"2024-04-26T00:50:41.464953+0000","last_became_active":"2024-04-26T00:50:39.853775+0000","last_became_peered":"2024-04-26T00:50:39.853775+0000","last_unstale":"2024-04-26T00:50:41.464953+0000","last_undegraded":"2024-04-26T00:50:41.464953+0000","last_fullsized":"2024-04-26T00:50:41.464953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468158+0000","last_change":"2024-04-26T00:50:38.863255+0000","last_active":"2024-04-26T00:50:41.468158+0000","last_peered":"2024-04-26T00:50:41.468158+0000","last_clean":"2024-04-26T00:50:41.468158+0000","last_became_active":"2024-04-26T00:50:38.861925+0000","last_became_peered":"2024-04-26T00:50:38.861925+0000","last_unstale":"2024-04-26T00:50:41.468158+0000","last_undegraded":"2024-04-26T00:50:41.468158+0000","last_fullsized":"2024-04-26T00:50:41.468158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:37.293965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852840+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:40.852840+0000","last_peered":"2024-04-26T00:50:40.852840+0000","last_clean":"2024-04-26T00:50:40.852840+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:40.852840+0000","last_undegraded":"2024-04-26T00:50:40.852840+0000","last_fullsized":"2024-04-26T00:50:40.852840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467285+0000","last_change":"2024-04-26T00:50:39.859688+0000","last_active":"2024-04-26T00:50:41.467285+0000","last_peered":"2024-04-26T00:50:41.467285+0000","last_clean":"2024-04-26T00:50:41.467285+0000","last_became_active":"2024-04-26T00:50:39.859353+0000","last_became_peered":"2024-04-26T00:50:39.859353+0000","last_unstale":"2024-04-26T00:50:41.467285+0000","last_undegraded":"2024-04-26T00:50:41.467285+0000","last_fullsized":"2024-04-26T00:50:41.467285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468552+0000","last_change":"2024-04-26T00:50:38.876486+0000","last_active":"2024-04-26T00:50:41.468552+0000","last_peered":"2024-04-26T00:50:41.468552+0000","last_clean":"2024-04-26T00:50:41.468552+0000","last_became_active":"2024-04-26T00:50:38.875909+0000","last_became_peered":"2024-04-26T00:50:38.875909+0000","last_unstale":"2024-04-26T00:50:41.468552+0000","last_undegraded":"2024-04-26T00:50:41.468552+0000","last_fullsized":"2024-04-26T00:50:41.468552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:40:21.077132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469439+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:41.469439+0000","last_peered":"2024-04-26T00:50:41.469439+0000","last_clean":"2024-04-26T00:50:41.469439+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:41.469439+0000","last_undegraded":"2024-04-26T00:50:41.469439+0000","last_fullsized":"2024-04-26T00:50:41.469439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464450+0000","last_change":"2024-04-26T00:50:39.848704+0000","last_active":"2024-04-26T00:50:41.464450+0000","last_peered":"2024-04-26T00:50:41.464450+0000","last_clean":"2024-04-26T00:50:41.464450+0000","last_became_active":"2024-04-26T00:50:39.848429+0000","last_became_peered":"2024-04-26T00:50:39.848429+0000","last_unstale":"2024-04-26T00:50:41.464450+0000","last_undegraded":"2024-04-26T00:50:41.464450+0000","last_fullsized":"2024-04-26T00:50:41.464450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:40.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.837302+0000","last_change":"2024-04-26T00:50:38.867565+0000","last_active":"2024-04-26T00:50:41.837302+0000","last_peered":"2024-04-26T00:50:41.837302+0000","last_clean":"2024-04-26T00:50:41.837302+0000","last_became_active":"2024-04-26T00:50:38.866728+0000","last_became_peered":"2024-04-26T00:50:38.866728+0000","last_unstale":"2024-04-26T00:50:41.837302+0000","last_undegraded":"2024-04-26T00:50:41.837302+0000","last_fullsized":"2024-04-26T00:50:41.837302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:23.691727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852376+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:40.852376+0000","last_peered":"2024-04-26T00:50:40.852376+0000","last_clean":"2024-04-26T00:50:40.852376+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:40.852376+0000","last_undegraded":"2024-04-26T00:50:40.852376+0000","last_fullsized":"2024-04-26T00:50:40.852376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854095+0000","last_change":"2024-04-26T00:50:39.856903+0000","last_active":"2024-04-26T00:50:40.854095+0000","last_peered":"2024-04-26T00:50:40.854095+0000","last_clean":"2024-04-26T00:50:40.854095+0000","last_became_active":"2024-04-26T00:50:39.856609+0000","last_became_peered":"2024-04-26T00:50:39.856609+0000","last_unstale":"2024-04-26T00:50:40.854095+0000","last_undegraded":"2024-04-26T00:50:40.854095+0000","last_fullsized":"2024-04-26T00:50:40.854095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:12.129353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854504+0000","last_change":"2024-04-26T00:50:39.857946+0000","last_active":"2024-04-26T00:50:40.854504+0000","last_peered":"2024-04-26T00:50:40.854504+0000","last_clean":"2024-04-26T00:50:40.854504+0000","last_became_active":"2024-04-26T00:50:39.857653+0000","last_became_peered":"2024-04-26T00:50:39.857653+0000","last_unstale":"2024-04-26T00:50:40.854504+0000","last_undegraded":"2024-04-26T00:50:40.854504+0000","last_fullsized":"2024-04-26T00:50:40.854504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:40.181948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851322+0000","last_change":"2024-04-26T00:50:38.846157+0000","last_active":"2024-04-26T00:50:40.851322+0000","last_peered":"2024-04-26T00:50:40.851322+0000","last_clean":"2024-04-26T00:50:40.851322+0000","last_became_active":"2024-04-26T00:50:38.845728+0000","last_became_peered":"2024-04-26T00:50:38.845728+0000","last_unstale":"2024-04-26T00:50:40.851322+0000","last_undegraded":"2024-04-26T00:50:40.851322+0000","last_fullsized":"2024-04-26T00:50:40.851322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465860+0000","last_change":"2024-04-26T00:50:39.851993+0000","last_active":"2024-04-26T00:50:41.465860+0000","last_peered":"2024-04-26T00:50:41.465860+0000","last_clean":"2024-04-26T00:50:41.465860+0000","last_became_active":"2024-04-26T00:50:39.851385+0000","last_became_peered":"2024-04-26T00:50:39.851385+0000","last_unstale":"2024-04-26T00:50:41.465860+0000","last_undegraded":"2024-04-26T00:50:41.465860+0000","last_fullsized":"2024-04-26T00:50:41.465860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855046+0000","last_change":"2024-04-26T00:50:38.859885+0000","last_active":"2024-04-26T00:50:40.855046+0000","last_peered":"2024-04-26T00:50:40.855046+0000","last_clean":"2024-04-26T00:50:40.855046+0000","last_became_active":"2024-04-26T00:50:38.858568+0000","last_became_peered":"2024-04-26T00:50:38.858568+0000","last_unstale":"2024-04-26T00:50:40.855046+0000","last_undegraded":"2024-04-26T00:50:40.855046+0000","last_fullsized":"2024-04-26T00:50:40.855046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851422+0000","last_change":"2024-04-26T00:50:38.866142+0000","last_active":"2024-04-26T00:50:40.851422+0000","last_peered":"2024-04-26T00:50:40.851422+0000","last_clean":"2024-04-26T00:50:40.851422+0000","last_became_active":"2024-04-26T00:50:38.865557+0000","last_became_peered":"2024-04-26T00:50:38.865557+0000","last_unstale":"2024-04-26T00:50:40.851422+0000","last_undegraded":"2024-04-26T00:50:40.851422+0000","last_fullsized":"2024-04-26T00:50:40.851422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:31.035091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466248+0000","last_change":"2024-04-26T00:50:39.854303+0000","last_active":"2024-04-26T00:50:41.466248+0000","last_peered":"2024-04-26T00:50:41.466248+0000","last_clean":"2024-04-26T00:50:41.466248+0000","last_became_active":"2024-04-26T00:50:39.852216+0000","last_became_peered":"2024-04-26T00:50:39.852216+0000","last_unstale":"2024-04-26T00:50:41.466248+0000","last_undegraded":"2024-04-26T00:50:41.466248+0000","last_fullsized":"2024-04-26T00:50:41.466248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469542+0000","last_change":"2024-04-26T00:50:38.867859+0000","last_active":"2024-04-26T00:50:41.469542+0000","last_peered":"2024-04-26T00:50:41.469542+0000","last_clean":"2024-04-26T00:50:41.469542+0000","last_became_active":"2024-04-26T00:50:38.866771+0000","last_became_peered":"2024-04-26T00:50:38.866771+0000","last_unstale":"2024-04-26T00:50:41.469542+0000","last_undegraded":"2024-04-26T00:50:41.469542+0000","last_fullsized":"2024-04-26T00:50:41.469542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464008+0000","last_change":"2024-04-26T00:50:39.851991+0000","last_active":"2024-04-26T00:50:41.464008+0000","last_peered":"2024-04-26T00:50:41.464008+0000","last_clean":"2024-04-26T00:50:41.464008+0000","last_became_active":"2024-04-26T00:50:39.851680+0000","last_became_peered":"2024-04-26T00:50:39.851680+0000","last_unstale":"2024-04-26T00:50:41.464008+0000","last_undegraded":"2024-04-26T00:50:41.464008+0000","last_fullsized":"2024-04-26T00:50:41.464008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:51.385973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852269+0000","last_change":"2024-04-26T00:50:39.859275+0000","last_active":"2024-04-26T00:50:40.852269+0000","last_peered":"2024-04-26T00:50:40.852269+0000","last_clean":"2024-04-26T00:50:40.852269+0000","last_became_active":"2024-04-26T00:50:39.858722+0000","last_became_peered":"2024-04-26T00:50:39.858722+0000","last_unstale":"2024-04-26T00:50:40.852269+0000","last_undegraded":"2024-04-26T00:50:40.852269+0000","last_fullsized":"2024-04-26T00:50:40.852269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:43.277704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464709+0000","last_change":"2024-04-26T00:50:38.876692+0000","last_active":"2024-04-26T00:50:41.464709+0000","last_peered":"2024-04-26T00:50:41.464709+0000","last_clean":"2024-04-26T00:50:41.464709+0000","last_became_active":"2024-04-26T00:50:38.875789+0000","last_became_peered":"2024-04-26T00:50:38.875789+0000","last_unstale":"2024-04-26T00:50:41.464709+0000","last_undegraded":"2024-04-26T00:50:41.464709+0000","last_fullsized":"2024-04-26T00:50:41.464709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468966+0000","last_change":"2024-04-26T00:50:39.853149+0000","last_active":"2024-04-26T00:50:41.468966+0000","last_peered":"2024-04-26T00:50:41.468966+0000","last_clean":"2024-04-26T00:50:41.468966+0000","last_became_active":"2024-04-26T00:50:39.852980+0000","last_became_peered":"2024-04-26T00:50:39.852980+0000","last_unstale":"2024-04-26T00:50:41.468966+0000","last_undegraded":"2024-04-26T00:50:41.468966+0000","last_fullsized":"2024-04-26T00:50:41.468966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465368+0000","last_change":"2024-04-26T00:50:38.868567+0000","last_active":"2024-04-26T00:50:41.465368+0000","last_peered":"2024-04-26T00:50:41.465368+0000","last_clean":"2024-04-26T00:50:41.465368+0000","last_became_active":"2024-04-26T00:50:38.867948+0000","last_became_peered":"2024-04-26T00:50:38.867948+0000","last_unstale":"2024-04-26T00:50:41.465368+0000","last_undegraded":"2024-04-26T00:50:41.465368+0000","last_fullsized":"2024-04-26T00:50:41.465368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:11.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466691+0000","last_change":"2024-04-26T00:50:39.860208+0000","last_active":"2024-04-26T00:50:41.466691+0000","last_peered":"2024-04-26T00:50:41.466691+0000","last_clean":"2024-04-26T00:50:41.466691+0000","last_became_active":"2024-04-26T00:50:39.859876+0000","last_became_peered":"2024-04-26T00:50:39.859876+0000","last_unstale":"2024-04-26T00:50:41.466691+0000","last_undegraded":"2024-04-26T00:50:41.466691+0000","last_fullsized":"2024-04-26T00:50:41.466691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850749+0000","last_change":"2024-04-26T00:50:38.866484+0000","last_active":"2024-04-26T00:50:40.850749+0000","last_peered":"2024-04-26T00:50:40.850749+0000","last_clean":"2024-04-26T00:50:40.850749+0000","last_became_active":"2024-04-26T00:50:38.865840+0000","last_became_peered":"2024-04-26T00:50:38.865840+0000","last_unstale":"2024-04-26T00:50:40.850749+0000","last_undegraded":"2024-04-26T00:50:40.850749+0000","last_fullsized":"2024-04-26T00:50:40.850749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:37.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855141+0000","last_change":"2024-04-26T00:50:39.866945+0000","last_active":"2024-04-26T00:50:40.855141+0000","last_peered":"2024-04-26T00:50:40.855141+0000","last_clean":"2024-04-26T00:50:40.855141+0000","last_became_active":"2024-04-26T00:50:39.866257+0000","last_became_peered":"2024-04-26T00:50:39.866257+0000","last_unstale":"2024-04-26T00:50:40.855141+0000","last_undegraded":"2024-04-26T00:50:40.855141+0000","last_fullsized":"2024-04-26T00:50:40.855141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:07.845148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466077+0000","last_change":"2024-04-26T00:50:38.870006+0000","last_active":"2024-04-26T00:50:41.466077+0000","last_peered":"2024-04-26T00:50:41.466077+0000","last_clean":"2024-04-26T00:50:41.466077+0000","last_became_active":"2024-04-26T00:50:38.869408+0000","last_became_peered":"2024-04-26T00:50:38.869408+0000","last_unstale":"2024-04-26T00:50:41.466077+0000","last_undegraded":"2024-04-26T00:50:41.466077+0000","last_fullsized":"2024-04-26T00:50:41.466077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:20.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854580+0000","last_change":"2024-04-26T00:50:39.867012+0000","last_active":"2024-04-26T00:50:40.854580+0000","last_peered":"2024-04-26T00:50:40.854580+0000","last_clean":"2024-04-26T00:50:40.854580+0000","last_became_active":"2024-04-26T00:50:39.866002+0000","last_became_peered":"2024-04-26T00:50:39.866002+0000","last_unstale":"2024-04-26T00:50:40.854580+0000","last_undegraded":"2024-04-26T00:50:40.854580+0000","last_fullsized":"2024-04-26T00:50:40.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:38.297542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467910+0000","last_change":"2024-04-26T00:50:38.868711+0000","last_active":"2024-04-26T00:50:41.467910+0000","last_peered":"2024-04-26T00:50:41.467910+0000","last_clean":"2024-04-26T00:50:41.467910+0000","last_became_active":"2024-04-26T00:50:38.868002+0000","last_became_peered":"2024-04-26T00:50:38.868002+0000","last_unstale":"2024-04-26T00:50:41.467910+0000","last_undegraded":"2024-04-26T00:50:41.467910+0000","last_fullsized":"2024-04-26T00:50:41.467910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:39.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850433+0000","last_change":"2024-04-26T00:50:39.857039+0000","last_active":"2024-04-26T00:50:40.850433+0000","last_peered":"2024-04-26T00:50:40.850433+0000","last_clean":"2024-04-26T00:50:40.850433+0000","last_became_active":"2024-04-26T00:50:39.856666+0000","last_became_peered":"2024-04-26T00:50:39.856666+0000","last_unstale":"2024-04-26T00:50:40.850433+0000","last_undegraded":"2024-04-26T00:50:40.850433+0000","last_fullsized":"2024-04-26T00:50:40.850433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852110+0000","last_change":"2024-04-26T00:50:38.849900+0000","last_active":"2024-04-26T00:50:40.852110+0000","last_peered":"2024-04-26T00:50:40.852110+0000","last_clean":"2024-04-26T00:50:40.852110+0000","last_became_active":"2024-04-26T00:50:38.849354+0000","last_became_peered":"2024-04-26T00:50:38.849354+0000","last_unstale":"2024-04-26T00:50:40.852110+0000","last_undegraded":"2024-04-26T00:50:40.852110+0000","last_fullsized":"2024-04-26T00:50:40.852110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:38.438162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467384+0000","last_change":"2024-04-26T00:50:39.863655+0000","last_active":"2024-04-26T00:50:41.467384+0000","last_peered":"2024-04-26T00:50:41.467384+0000","last_clean":"2024-04-26T00:50:41.467384+0000","last_became_active":"2024-04-26T00:50:39.863378+0000","last_became_peered":"2024-04-26T00:50:39.863378+0000","last_unstale":"2024-04-26T00:50:41.467384+0000","last_undegraded":"2024-04-26T00:50:41.467384+0000","last_fullsized":"2024-04-26T00:50:41.467384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467256+0000","last_change":"2024-04-26T00:50:38.876385+0000","last_active":"2024-04-26T00:50:41.467256+0000","last_peered":"2024-04-26T00:50:41.467256+0000","last_clean":"2024-04-26T00:50:41.467256+0000","last_became_active":"2024-04-26T00:50:38.875458+0000","last_became_peered":"2024-04-26T00:50:38.875458+0000","last_unstale":"2024-04-26T00:50:41.467256+0000","last_undegraded":"2024-04-26T00:50:41.467256+0000","last_fullsized":"2024-04-26T00:50:41.467256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849703+0000","last_change":"2024-04-26T00:50:39.847368+0000","last_active":"2024-04-26T00:50:40.849703+0000","last_peered":"2024-04-26T00:50:40.849703+0000","last_clean":"2024-04-26T00:50:40.849703+0000","last_became_active":"2024-04-26T00:50:39.845961+0000","last_became_peered":"2024-04-26T00:50:39.845961+0000","last_unstale":"2024-04-26T00:50:40.849703+0000","last_undegraded":"2024-04-26T00:50:40.849703+0000","last_fullsized":"2024-04-26T00:50:40.849703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469540+0000","last_change":"2024-04-26T00:50:38.873696+0000","last_active":"2024-04-26T00:50:41.469540+0000","last_peered":"2024-04-26T00:50:41.469540+0000","last_clean":"2024-04-26T00:50:41.469540+0000","last_became_active":"2024-04-26T00:50:38.873136+0000","last_became_peered":"2024-04-26T00:50:38.873136+0000","last_unstale":"2024-04-26T00:50:41.469540+0000","last_undegraded":"2024-04-26T00:50:41.469540+0000","last_fullsized":"2024-04-26T00:50:41.469540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:19.993664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":656236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":654556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:44.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T00:50:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.804+0000 7fbc79024640 1 Processor -- start 2024-04-26T00:50:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.804+0000 7fbc79024640 1 -- start start 2024-04-26T00:50:44.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.804+0000 7fbc79024640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbc74072430 0x7fbc740a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.804+0000 7fbc79024640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 0x7fbc7414c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc740728d0 con 0x7fbc7406d4b0 2024-04-26T00:50:44.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbc7406d890 con 0x7fbc74072430 2024-04-26T00:50:44.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fbc74071f30 con 0x7fbc74073290 2024-04-26T00:50:44.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc72d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc7406d4b0 0x7fbc74071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41140/0 (socket says 172.21.15.6:41140) 2024-04-26T00:50:44.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc72d9d640 1 -- 172.21.15.6:0/1893383815 learned_addr learned my addr 172.21.15.6:0/1893383815 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:44.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 --2- 172.21.15.6:0/1893383815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 0x7fbc7414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7259c640 1 --2- 172.21.15.6:0/1893383815 >> v2:172.21.15.188:3300/0 conn(0x7fbc74072430 0x7fbc740a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc71d9b640 1 -- 172.21.15.6:0/1893383815 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770277054 0 0) 0x7fbc740728d0 con 0x7fbc7406d4b0 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc71d9b640 1 -- 172.21.15.6:0/1893383815 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc5c003530 con 0x7fbc7406d4b0 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 -- 172.21.15.6:0/1893383815 >> v2:172.21.15.188:3300/0 conn(0x7fbc74072430 msgr2=0x7fbc740a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 --2- 172.21.15.6:0/1893383815 >> v2:172.21.15.188:3300/0 conn(0x7fbc74072430 0x7fbc740a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 -- 172.21.15.6:0/1893383815 >> v1:172.21.15.6:6789/0 conn(0x7fbc7406d4b0 legacy=0x7fbc74071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 -- 172.21.15.6:0/1893383815 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74072b90 con 0x7fbc74073290 2024-04-26T00:50:44.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc7359e640 1 --2- 172.21.15.6:0/1893383815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 0x7fbc7414c470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009d90 tx=0x7fbc6c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9c74f86118bc1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc71d9b640 1 -- 172.21.15.6:0/1893383815 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b2070 con 0x7fbc74073290 2024-04-26T00:50:44.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc71d9b640 1 -- 172.21.15.6:0/1893383815 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0a5970 con 0x7fbc74073290 2024-04-26T00:50:44.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc71d9b640 1 -- 172.21.15.6:0/1893383815 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a5d40 con 0x7fbc74073290 2024-04-26T00:50:44.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- 172.21.15.6:0/1893383815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 msgr2=0x7fbc7414c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 --2- 172.21.15.6:0/1893383815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 0x7fbc7414c470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009d90 tx=0x7fbc6c01c890 comp rx=0 tx=0).stop 2024-04-26T00:50:44.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- 172.21.15.6:0/1893383815 shutdown_connections 2024-04-26T00:50:44.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 --2- 172.21.15.6:0/1893383815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74073290 0x7fbc7414c470 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 --2- 172.21.15.6:0/1893383815 >> v2:172.21.15.188:3300/0 conn(0x7fbc74072430 0x7fbc740a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- 172.21.15.6:0/1893383815 >> 172.21.15.6:0/1893383815 conn(0x7fbc7406f250 msgr2=0x7fbc7406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.808+0000 7fbc79024640 1 -- 172.21.15.6:0/1893383815 shutdown_connections 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- 172.21.15.6:0/1893383815 wait complete. 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 Processor -- start 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- start start 2024-04-26T00:50:44.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74072430 0x7fbc741306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc74073290 0x7fbc740b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7414d590 con 0x7fbc7406d4b0 2024-04-26T00:50:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7414d410 con 0x7fbc74073290 2024-04-26T00:50:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fbc7414d710 con 0x7fbc74072430 2024-04-26T00:50:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38340/0 (socket says 172.21.15.6:38340) 2024-04-26T00:50:44.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 -- 172.21.15.6:0/1327196604 learned_addr learned my addr 172.21.15.6:0/1327196604 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc7259c640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74072430 0x7fbc741306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc7359e640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc74073290 0x7fbc740b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 -- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74072430 msgr2=0x7fbc741306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74072430 0x7fbc741306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 -- 172.21.15.6:0/1327196604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc74073290 msgr2=0x7fbc740b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc74073290 0x7fbc740b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 -- 172.21.15.6:0/1327196604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74130e30 con 0x7fbc7406d4b0 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc72d9d640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c450 tx=0x7fbc6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64017070 con 0x7fbc7406d4b0 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64005cf0 con 0x7fbc7406d4b0 2024-04-26T00:50:44.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc740b4900 con 0x7fbc7406d4b0 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64007290 con 0x7fbc7406d4b0 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7413de90 con 0x7fbc7406d4b0 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.812+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7406db70 con 0x7fbc7406d4b0 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fbc6401a070 con 0x7fbc7406d4b0 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:44.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 0x7fbc6009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc7259c640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 0x7fbc6009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fbc640c1b30 con 0x7fbc7406d4b0 2024-04-26T00:50:44.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.816+0000 7fbc7259c640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 0x7fbc6009b880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406c6d0 tx=0x7fbc68009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:44.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:44.820+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbc64021020 con 0x7fbc7406d4b0 2024-04-26T00:50:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.036+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbc7406ced0 con 0x7fbc7406d4b0 2024-04-26T00:50:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.036+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/1327196604 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7fbc64092a20 con 0x7fbc7406d4b0 2024-04-26T00:50:45.046 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:45.046 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":4,"num_up_osds":4,"osd_up_since":1714092626,"num_in_osds":4,"osd_in_since":1714092618,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592778,"bytes_used":116932608,"bytes_avail":386430124032,"bytes_total":386547056640,"write_bytes_sec":2383,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4243}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T00:50:17.377988+0000","services":{}},"progress_events":{}} 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 10 mgrc shutdown 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 msgr2=0x7fbc6009b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 0x7fbc6009b880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406c6d0 tx=0x7fbc68009190 comp rx=0 tx=0).stop 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 msgr2=0x7fbc7413e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c450 tx=0x7fbc6400c910 comp rx=0 tx=0).stop 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 shutdown_connections 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fbc600993c0 0x7fbc6009b880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc74073290 0x7fbc740b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbc74072430 0x7fbc741306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 --2- 172.21.15.6:0/1327196604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc7406d4b0 0x7fbc7413e420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 >> 172.21.15.6:0/1327196604 conn(0x7fbc7406f250 msgr2=0x7fbc74070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 shutdown_connections 2024-04-26T00:50:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.040+0000 7fbc79024640 1 -- 172.21.15.6:0/1327196604 wait complete. 2024-04-26T00:50:45.063 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T00:50:45.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:45.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.164+0000 7fd57b7cc640 1 Processor -- start 2024-04-26T00:50:45.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.164+0000 7fd57b7cc640 1 -- start start 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd57b7cc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd574135eb0 0x7fd574072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd57b7cc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd574135860 con 0x7fd5740ab490 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd57b7cc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd574135b00 con 0x7fd574139470 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd57b7cc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd574073710 con 0x7fd574135eb0 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579d69640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5740ab490 0x7fd57414d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41148/0 (socket says 172.21.15.6:41148) 2024-04-26T00:50:45.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579d69640 1 -- 172.21.15.6:0/2769802145 learned_addr learned my addr 172.21.15.6:0/2769802145 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709640110 0 0) 0x7fd574135860 con 0x7fd5740ab490 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd560003530 con 0x7fd5740ab490 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 --2- 172.21.15.6:0/2769802145 >> v2:172.21.15.188:3300/0 conn(0x7fd574135eb0 0x7fd574072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1098841333 0 0) 0x7fd560003530 con 0x7fd5740ab490 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 >> v2:172.21.15.188:3300/0 conn(0x7fd574135eb0 msgr2=0x7fd574072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 --2- 172.21.15.6:0/2769802145 >> v2:172.21.15.188:3300/0 conn(0x7fd574135eb0 0x7fd574072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 >> v1:172.21.15.188:6789/0 conn(0x7fd574139470 legacy=0x7fd57406d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5741354b0 con 0x7fd5740ab490 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7fd56c001680 con 0x7fd5740ab490 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 >> v1:172.21.15.6:6789/0 conn(0x7fd5740ab490 legacy=0x7fd57414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 0x7fd560003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd560004810 0x7fd560004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600052f0 0x7fd56000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd574073710 con 0x7fd5600039c0 2024-04-26T00:50:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd56000c1c0 con 0x7fd560004810 2024-04-26T00:50:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd56000c3c0 con 0x7fd5600052f0 2024-04-26T00:50:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 0x7fd560003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579d69640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600052f0 0x7fd56000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd578d67640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd560004810 0x7fd560004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 -- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600052f0 msgr2=0x7fd56000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600052f0 0x7fd56000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 -- 172.21.15.6:0/2769802145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd560004810 msgr2=0x7fd560004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd560004810 0x7fd560004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 -- 172.21.15.6:0/2769802145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd560003530 con 0x7fd5600039c0 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579d69640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600052f0 0x7fd56000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579d69640 1 -- 172.21.15.6:0/2769802145 reap_dead start 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd579568640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 0x7fd560003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd56800ba00 tx=0x7fd56801c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d9082673e96f56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5680b2070 con 0x7fd5600039c0 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5680ad410 con 0x7fd5600039c0 2024-04-26T00:50:45.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.168+0000 7fd567fff640 1 -- 172.21.15.6:0/2769802145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56800b600 con 0x7fd5600039c0 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 msgr2=0x7fd560003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 0x7fd560003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd56800ba00 tx=0x7fd56801c620 comp rx=0 tx=0).stop 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2769802145 shutdown_connections 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2769802145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5600039c0 0x7fd560003de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2769802145 >> 172.21.15.6:0/2769802145 conn(0x7fd57406f480 msgr2=0x7fd57406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:45.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2769802145 shutdown_connections 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2769802145 wait complete. 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 Processor -- start 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- start start 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 0x7fd5741ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5740a3da0 0x7fd5741317a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd57406c5d0 con 0x7fd574131ce0 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd57406c450 con 0x7fd5740a3da0 2024-04-26T00:50:45.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd57406c750 con 0x7fd5600039c0 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579568640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 0x7fd5741ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38354/0 (socket says 172.21.15.6:38354) 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 -- 172.21.15.6:0/2505679322 learned_addr learned my addr 172.21.15.6:0/2505679322 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd578d67640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5740a3da0 0x7fd5741317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 -- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 msgr2=0x7fd5741ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 0x7fd5741ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 -- 172.21.15.6:0/2505679322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5740a3da0 msgr2=0x7fd5741317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5740a3da0 0x7fd5741317a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 -- 172.21.15.6:0/2505679322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5741d9790 con 0x7fd574131ce0 2024-04-26T00:50:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579568640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 0x7fd5741ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd579d69640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd57406dac0 tx=0x7fd56c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c018070 con 0x7fd574131ce0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c00f910 con 0x7fd574131ce0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c007d40 con 0x7fd574131ce0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5741cf650 con 0x7fd574131ce0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5741d9f90 con 0x7fd574131ce0 2024-04-26T00:50:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.172+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57406db70 con 0x7fd574131ce0 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd56c01b070 con 0x7fd574131ce0 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 0x7fd55809b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd579568640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 0x7fd55809b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd56c0c1830 con 0x7fd574131ce0 2024-04-26T00:50:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.176+0000 7fd579568640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 0x7fd55809b780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd560004790 tx=0x7fd5680046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:45.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.180+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd56c092720 con 0x7fd574131ce0 2024-04-26T00:50:45.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.332+0000 7fd57b7cc640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:45.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.332+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd574132160 con 0x7fd5580992c0 2024-04-26T00:50:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.352+0000 7fd565ffb640 1 -- 172.21.15.6:0/2505679322 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268604 (secure 0 0 0) 0x7fd5680ae1c0 con 0x7fd5580992c0 2024-04-26T00:50:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.352+0000 7fd565ffb640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:45.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:45.365 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 10 mgrc shutdown 2024-04-26T00:50:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 msgr2=0x7fd55809b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 0x7fd55809b780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd560004790 tx=0x7fd5680046d0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 msgr2=0x7fd5741d9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd57406dac0 tx=0x7fd56c007720 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 shutdown_connections 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd5580992c0 0x7fd55809b780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574131ce0 0x7fd5741d9a50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5740a3da0 0x7fd5741317a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 --2- 172.21.15.6:0/2505679322 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5600039c0 0x7fd5741ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 >> 172.21.15.6:0/2505679322 conn(0x7fd57406f480 msgr2=0x7fd5740a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 shutdown_connections 2024-04-26T00:50:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:45.356+0000 7fd57b7cc640 1 -- 172.21.15.6:0/2505679322 wait complete. 2024-04-26T00:50:45.381 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T00:50:44.255781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114192,"kb_used_data":1944,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373168,"statfs":{"total":386547056640,"available":386430124032,"internally_reserved":0,"allocated":1990656,"data_stored":1439892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013441"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855209+0000","last_change":"2024-04-26T00:50:39.864060+0000","last_active":"2024-04-26T00:50:40.855209+0000","last_peered":"2024-04-26T00:50:40.855209+0000","last_clean":"2024-04-26T00:50:40.855209+0000","last_became_active":"2024-04-26T00:50:39.863233+0000","last_became_peered":"2024-04-26T00:50:39.863233+0000","last_unstale":"2024-04-26T00:50:40.855209+0000","last_undegraded":"2024-04-26T00:50:40.855209+0000","last_fullsized":"2024-04-26T00:50:40.855209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.858910+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858358+0000","last_became_peered":"2024-04-26T00:50:39.858358+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.333493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.859022+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858634+0000","last_became_peered":"2024-04-26T00:50:39.858634+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:01:18.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464955+0000","last_change":"2024-04-26T00:50:39.861410+0000","last_active":"2024-04-26T00:50:41.464955+0000","last_peered":"2024-04-26T00:50:41.464955+0000","last_clean":"2024-04-26T00:50:41.464955+0000","last_became_active":"2024-04-26T00:50:39.860413+0000","last_became_peered":"2024-04-26T00:50:39.860413+0000","last_unstale":"2024-04-26T00:50:41.464955+0000","last_undegraded":"2024-04-26T00:50:41.464955+0000","last_fullsized":"2024-04-26T00:50:41.464955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465774+0000","last_change":"2024-04-26T00:50:39.854723+0000","last_active":"2024-04-26T00:50:41.465774+0000","last_peered":"2024-04-26T00:50:41.465774+0000","last_clean":"2024-04-26T00:50:41.465774+0000","last_became_active":"2024-04-26T00:50:39.854507+0000","last_became_peered":"2024-04-26T00:50:39.854507+0000","last_unstale":"2024-04-26T00:50:41.465774+0000","last_undegraded":"2024-04-26T00:50:41.465774+0000","last_fullsized":"2024-04-26T00:50:41.465774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:58.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465520+0000","last_change":"2024-04-26T00:50:39.848920+0000","last_active":"2024-04-26T00:50:41.465520+0000","last_peered":"2024-04-26T00:50:41.465520+0000","last_clean":"2024-04-26T00:50:41.465520+0000","last_became_active":"2024-04-26T00:50:39.848576+0000","last_became_peered":"2024-04-26T00:50:39.848576+0000","last_unstale":"2024-04-26T00:50:41.465520+0000","last_undegraded":"2024-04-26T00:50:41.465520+0000","last_fullsized":"2024-04-26T00:50:41.465520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:00.751396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465029+0000","last_change":"2024-04-26T00:50:39.848389+0000","last_active":"2024-04-26T00:50:41.465029+0000","last_peered":"2024-04-26T00:50:41.465029+0000","last_clean":"2024-04-26T00:50:41.465029+0000","last_became_active":"2024-04-26T00:50:39.847874+0000","last_became_peered":"2024-04-26T00:50:39.847874+0000","last_unstale":"2024-04-26T00:50:41.465029+0000","last_undegraded":"2024-04-26T00:50:41.465029+0000","last_fullsized":"2024-04-26T00:50:41.465029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:28.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849307+0000","last_change":"2024-04-26T00:50:39.863022+0000","last_active":"2024-04-26T00:50:40.849307+0000","last_peered":"2024-04-26T00:50:40.849307+0000","last_clean":"2024-04-26T00:50:40.849307+0000","last_became_active":"2024-04-26T00:50:39.862653+0000","last_became_peered":"2024-04-26T00:50:39.862653+0000","last_unstale":"2024-04-26T00:50:40.849307+0000","last_undegraded":"2024-04-26T00:50:40.849307+0000","last_fullsized":"2024-04-26T00:50:40.849307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855363+0000","last_change":"2024-04-26T00:50:39.864364+0000","last_active":"2024-04-26T00:50:40.855363+0000","last_peered":"2024-04-26T00:50:40.855363+0000","last_clean":"2024-04-26T00:50:40.855363+0000","last_became_active":"2024-04-26T00:50:39.863765+0000","last_became_peered":"2024-04-26T00:50:39.863765+0000","last_unstale":"2024-04-26T00:50:40.855363+0000","last_undegraded":"2024-04-26T00:50:40.855363+0000","last_fullsized":"2024-04-26T00:50:40.855363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:03.262591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468765+0000","last_change":"2024-04-26T00:50:39.860856+0000","last_active":"2024-04-26T00:50:41.468765+0000","last_peered":"2024-04-26T00:50:41.468765+0000","last_clean":"2024-04-26T00:50:41.468765+0000","last_became_active":"2024-04-26T00:50:39.860592+0000","last_became_peered":"2024-04-26T00:50:39.860592+0000","last_unstale":"2024-04-26T00:50:41.468765+0000","last_undegraded":"2024-04-26T00:50:41.468765+0000","last_fullsized":"2024-04-26T00:50:41.468765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468466+0000","last_change":"2024-04-26T00:50:39.854576+0000","last_active":"2024-04-26T00:50:41.468466+0000","last_peered":"2024-04-26T00:50:41.468466+0000","last_clean":"2024-04-26T00:50:41.468466+0000","last_became_active":"2024-04-26T00:50:39.854290+0000","last_became_peered":"2024-04-26T00:50:39.854290+0000","last_unstale":"2024-04-26T00:50:41.468466+0000","last_undegraded":"2024-04-26T00:50:41.468466+0000","last_fullsized":"2024-04-26T00:50:41.468466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855221+0000","last_change":"2024-04-26T00:50:39.867495+0000","last_active":"2024-04-26T00:50:40.855221+0000","last_peered":"2024-04-26T00:50:40.855221+0000","last_clean":"2024-04-26T00:50:40.855221+0000","last_became_active":"2024-04-26T00:50:39.866525+0000","last_became_peered":"2024-04-26T00:50:39.866525+0000","last_unstale":"2024-04-26T00:50:40.855221+0000","last_undegraded":"2024-04-26T00:50:40.855221+0000","last_fullsized":"2024-04-26T00:50:40.855221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854314+0000","last_change":"2024-04-26T00:50:39.866036+0000","last_active":"2024-04-26T00:50:40.854314+0000","last_peered":"2024-04-26T00:50:40.854314+0000","last_clean":"2024-04-26T00:50:40.854314+0000","last_became_active":"2024-04-26T00:50:39.864772+0000","last_became_peered":"2024-04-26T00:50:39.864772+0000","last_unstale":"2024-04-26T00:50:40.854314+0000","last_undegraded":"2024-04-26T00:50:40.854314+0000","last_fullsized":"2024-04-26T00:50:40.854314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:20.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850148+0000","last_change":"2024-04-26T00:50:39.850402+0000","last_active":"2024-04-26T00:50:40.850148+0000","last_peered":"2024-04-26T00:50:40.850148+0000","last_clean":"2024-04-26T00:50:40.850148+0000","last_became_active":"2024-04-26T00:50:39.849824+0000","last_became_peered":"2024-04-26T00:50:39.849824+0000","last_unstale":"2024-04-26T00:50:40.850148+0000","last_undegraded":"2024-04-26T00:50:40.850148+0000","last_fullsized":"2024-04-26T00:50:40.850148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849803+0000","last_change":"2024-04-26T00:50:39.859504+0000","last_active":"2024-04-26T00:50:40.849803+0000","last_peered":"2024-04-26T00:50:40.849803+0000","last_clean":"2024-04-26T00:50:40.849803+0000","last_became_active":"2024-04-26T00:50:39.858895+0000","last_became_peered":"2024-04-26T00:50:39.858895+0000","last_unstale":"2024-04-26T00:50:40.849803+0000","last_undegraded":"2024-04-26T00:50:40.849803+0000","last_fullsized":"2024-04-26T00:50:40.849803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849230+0000","last_change":"2024-04-26T00:50:39.862674+0000","last_active":"2024-04-26T00:50:40.849230+0000","last_peered":"2024-04-26T00:50:40.849230+0000","last_clean":"2024-04-26T00:50:40.849230+0000","last_became_active":"2024-04-26T00:50:39.862064+0000","last_became_peered":"2024-04-26T00:50:39.862064+0000","last_unstale":"2024-04-26T00:50:40.849230+0000","last_undegraded":"2024-04-26T00:50:40.849230+0000","last_fullsized":"2024-04-26T00:50:40.849230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469383+0000","last_change":"2024-04-26T00:50:39.868719+0000","last_active":"2024-04-26T00:50:41.469383+0000","last_peered":"2024-04-26T00:50:41.469383+0000","last_clean":"2024-04-26T00:50:41.469383+0000","last_became_active":"2024-04-26T00:50:39.868234+0000","last_became_peered":"2024-04-26T00:50:39.868234+0000","last_unstale":"2024-04-26T00:50:41.469383+0000","last_undegraded":"2024-04-26T00:50:41.469383+0000","last_fullsized":"2024-04-26T00:50:41.469383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467114+0000","last_change":"2024-04-26T00:50:39.864259+0000","last_active":"2024-04-26T00:50:41.467114+0000","last_peered":"2024-04-26T00:50:41.467114+0000","last_clean":"2024-04-26T00:50:41.467114+0000","last_became_active":"2024-04-26T00:50:39.863983+0000","last_became_peered":"2024-04-26T00:50:39.863983+0000","last_unstale":"2024-04-26T00:50:41.467114+0000","last_undegraded":"2024-04-26T00:50:41.467114+0000","last_fullsized":"2024-04-26T00:50:41.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854744+0000","last_change":"2024-04-26T00:50:39.865590+0000","last_active":"2024-04-26T00:50:40.854744+0000","last_peered":"2024-04-26T00:50:40.854744+0000","last_clean":"2024-04-26T00:50:40.854744+0000","last_became_active":"2024-04-26T00:50:39.865319+0000","last_became_peered":"2024-04-26T00:50:39.865319+0000","last_unstale":"2024-04-26T00:50:40.854744+0000","last_undegraded":"2024-04-26T00:50:40.854744+0000","last_fullsized":"2024-04-26T00:50:40.854744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:20.997241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467605+0000","last_change":"2024-04-26T00:50:39.856108+0000","last_active":"2024-04-26T00:50:41.467605+0000","last_peered":"2024-04-26T00:50:41.467605+0000","last_clean":"2024-04-26T00:50:41.467605+0000","last_became_active":"2024-04-26T00:50:39.855807+0000","last_became_peered":"2024-04-26T00:50:39.855807+0000","last_unstale":"2024-04-26T00:50:41.467605+0000","last_undegraded":"2024-04-26T00:50:41.467605+0000","last_fullsized":"2024-04-26T00:50:41.467605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850863+0000","last_change":"2024-04-26T00:50:39.843134+0000","last_active":"2024-04-26T00:50:40.850863+0000","last_peered":"2024-04-26T00:50:40.850863+0000","last_clean":"2024-04-26T00:50:40.850863+0000","last_became_active":"2024-04-26T00:50:39.842326+0000","last_became_peered":"2024-04-26T00:50:39.842326+0000","last_unstale":"2024-04-26T00:50:40.850863+0000","last_undegraded":"2024-04-26T00:50:40.850863+0000","last_fullsized":"2024-04-26T00:50:40.850863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:10:05.591117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464540+0000","last_change":"2024-04-26T00:50:39.854346+0000","last_active":"2024-04-26T00:50:41.464540+0000","last_peered":"2024-04-26T00:50:41.464540+0000","last_clean":"2024-04-26T00:50:41.464540+0000","last_became_active":"2024-04-26T00:50:39.854039+0000","last_became_peered":"2024-04-26T00:50:39.854039+0000","last_unstale":"2024-04-26T00:50:41.464540+0000","last_undegraded":"2024-04-26T00:50:41.464540+0000","last_fullsized":"2024-04-26T00:50:41.464540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465787+0000","last_change":"2024-04-26T00:50:39.860520+0000","last_active":"2024-04-26T00:50:41.465787+0000","last_peered":"2024-04-26T00:50:41.465787+0000","last_clean":"2024-04-26T00:50:41.465787+0000","last_became_active":"2024-04-26T00:50:39.859357+0000","last_became_peered":"2024-04-26T00:50:39.859357+0000","last_unstale":"2024-04-26T00:50:41.465787+0000","last_undegraded":"2024-04-26T00:50:41.465787+0000","last_fullsized":"2024-04-26T00:50:41.465787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849398+0000","last_change":"2024-04-26T00:50:39.858882+0000","last_active":"2024-04-26T00:50:40.849398+0000","last_peered":"2024-04-26T00:50:40.849398+0000","last_clean":"2024-04-26T00:50:40.849398+0000","last_became_active":"2024-04-26T00:50:39.858565+0000","last_became_peered":"2024-04-26T00:50:39.858565+0000","last_unstale":"2024-04-26T00:50:40.849398+0000","last_undegraded":"2024-04-26T00:50:40.849398+0000","last_fullsized":"2024-04-26T00:50:40.849398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468918+0000","last_change":"2024-04-26T00:50:39.857963+0000","last_active":"2024-04-26T00:50:41.468918+0000","last_peered":"2024-04-26T00:50:41.468918+0000","last_clean":"2024-04-26T00:50:41.468918+0000","last_became_active":"2024-04-26T00:50:39.857599+0000","last_became_peered":"2024-04-26T00:50:39.857599+0000","last_unstale":"2024-04-26T00:50:41.468918+0000","last_undegraded":"2024-04-26T00:50:41.468918+0000","last_fullsized":"2024-04-26T00:50:41.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469225+0000","last_change":"2024-04-26T00:50:39.863645+0000","last_active":"2024-04-26T00:50:41.469225+0000","last_peered":"2024-04-26T00:50:41.469225+0000","last_clean":"2024-04-26T00:50:41.469225+0000","last_became_active":"2024-04-26T00:50:39.863391+0000","last_became_peered":"2024-04-26T00:50:39.863391+0000","last_unstale":"2024-04-26T00:50:41.469225+0000","last_undegraded":"2024-04-26T00:50:41.469225+0000","last_fullsized":"2024-04-26T00:50:41.469225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852851+0000","last_change":"2024-04-26T00:50:39.860126+0000","last_active":"2024-04-26T00:50:40.852851+0000","last_peered":"2024-04-26T00:50:40.852851+0000","last_clean":"2024-04-26T00:50:40.852851+0000","last_became_active":"2024-04-26T00:50:39.859701+0000","last_became_peered":"2024-04-26T00:50:39.859701+0000","last_unstale":"2024-04-26T00:50:40.852851+0000","last_undegraded":"2024-04-26T00:50:40.852851+0000","last_fullsized":"2024-04-26T00:50:40.852851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:26:07.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468277+0000","last_change":"2024-04-26T00:50:39.868579+0000","last_active":"2024-04-26T00:50:41.468277+0000","last_peered":"2024-04-26T00:50:41.468277+0000","last_clean":"2024-04-26T00:50:41.468277+0000","last_became_active":"2024-04-26T00:50:39.868213+0000","last_became_peered":"2024-04-26T00:50:39.868213+0000","last_unstale":"2024-04-26T00:50:41.468277+0000","last_undegraded":"2024-04-26T00:50:41.468277+0000","last_fullsized":"2024-04-26T00:50:41.468277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465290+0000","last_change":"2024-04-26T00:50:39.855232+0000","last_active":"2024-04-26T00:50:41.465290+0000","last_peered":"2024-04-26T00:50:41.465290+0000","last_clean":"2024-04-26T00:50:41.465290+0000","last_became_active":"2024-04-26T00:50:39.852449+0000","last_became_peered":"2024-04-26T00:50:39.852449+0000","last_unstale":"2024-04-26T00:50:41.465290+0000","last_undegraded":"2024-04-26T00:50:41.465290+0000","last_fullsized":"2024-04-26T00:50:41.465290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:10.850384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465536+0000","last_change":"2024-04-26T00:50:39.852258+0000","last_active":"2024-04-26T00:50:41.465536+0000","last_peered":"2024-04-26T00:50:41.465536+0000","last_clean":"2024-04-26T00:50:41.465536+0000","last_became_active":"2024-04-26T00:50:39.851730+0000","last_became_peered":"2024-04-26T00:50:39.851730+0000","last_unstale":"2024-04-26T00:50:41.465536+0000","last_undegraded":"2024-04-26T00:50:41.465536+0000","last_fullsized":"2024-04-26T00:50:41.465536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465455+0000","last_change":"2024-04-26T00:50:39.848331+0000","last_active":"2024-04-26T00:50:41.465455+0000","last_peered":"2024-04-26T00:50:41.465455+0000","last_clean":"2024-04-26T00:50:41.465455+0000","last_became_active":"2024-04-26T00:50:39.848027+0000","last_became_peered":"2024-04-26T00:50:39.848027+0000","last_unstale":"2024-04-26T00:50:41.465455+0000","last_undegraded":"2024-04-26T00:50:41.465455+0000","last_fullsized":"2024-04-26T00:50:41.465455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:10.545861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849646+0000","last_change":"2024-04-26T00:50:39.862385+0000","last_active":"2024-04-26T00:50:40.849646+0000","last_peered":"2024-04-26T00:50:40.849646+0000","last_clean":"2024-04-26T00:50:40.849646+0000","last_became_active":"2024-04-26T00:50:39.861979+0000","last_became_peered":"2024-04-26T00:50:39.861979+0000","last_unstale":"2024-04-26T00:50:40.849646+0000","last_undegraded":"2024-04-26T00:50:40.849646+0000","last_fullsized":"2024-04-26T00:50:40.849646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465788+0000","last_change":"2024-04-26T00:50:39.857971+0000","last_active":"2024-04-26T00:50:41.465788+0000","last_peered":"2024-04-26T00:50:41.465788+0000","last_clean":"2024-04-26T00:50:41.465788+0000","last_became_active":"2024-04-26T00:50:39.857706+0000","last_became_peered":"2024-04-26T00:50:39.857706+0000","last_unstale":"2024-04-26T00:50:41.465788+0000","last_undegraded":"2024-04-26T00:50:41.465788+0000","last_fullsized":"2024-04-26T00:50:41.465788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466603+0000","last_change":"2024-04-26T00:50:38.870203+0000","last_active":"2024-04-26T00:50:41.466603+0000","last_peered":"2024-04-26T00:50:41.466603+0000","last_clean":"2024-04-26T00:50:41.466603+0000","last_became_active":"2024-04-26T00:50:38.869667+0000","last_became_peered":"2024-04-26T00:50:38.869667+0000","last_unstale":"2024-04-26T00:50:41.466603+0000","last_undegraded":"2024-04-26T00:50:41.466603+0000","last_fullsized":"2024-04-26T00:50:41.466603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.946855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466766+0000","last_change":"2024-04-26T00:50:39.851780+0000","last_active":"2024-04-26T00:50:41.466766+0000","last_peered":"2024-04-26T00:50:41.466766+0000","last_clean":"2024-04-26T00:50:41.466766+0000","last_became_active":"2024-04-26T00:50:39.851487+0000","last_became_peered":"2024-04-26T00:50:39.851487+0000","last_unstale":"2024-04-26T00:50:41.466766+0000","last_undegraded":"2024-04-26T00:50:41.466766+0000","last_fullsized":"2024-04-26T00:50:41.466766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854350+0000","last_change":"2024-04-26T00:50:38.858405+0000","last_active":"2024-04-26T00:50:40.854350+0000","last_peered":"2024-04-26T00:50:40.854350+0000","last_clean":"2024-04-26T00:50:40.854350+0000","last_became_active":"2024-04-26T00:50:38.857294+0000","last_became_peered":"2024-04-26T00:50:38.857294+0000","last_unstale":"2024-04-26T00:50:40.854350+0000","last_undegraded":"2024-04-26T00:50:40.854350+0000","last_fullsized":"2024-04-26T00:50:40.854350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.943770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466331+0000","last_change":"2024-04-26T00:50:39.854371+0000","last_active":"2024-04-26T00:50:41.466331+0000","last_peered":"2024-04-26T00:50:41.466331+0000","last_clean":"2024-04-26T00:50:41.466331+0000","last_became_active":"2024-04-26T00:50:39.851258+0000","last_became_peered":"2024-04-26T00:50:39.851258+0000","last_unstale":"2024-04-26T00:50:41.466331+0000","last_undegraded":"2024-04-26T00:50:41.466331+0000","last_fullsized":"2024-04-26T00:50:41.466331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850071+0000","last_change":"2024-04-26T00:50:38.855662+0000","last_active":"2024-04-26T00:50:40.850071+0000","last_peered":"2024-04-26T00:50:40.850071+0000","last_clean":"2024-04-26T00:50:40.850071+0000","last_became_active":"2024-04-26T00:50:38.855264+0000","last_became_peered":"2024-04-26T00:50:38.855264+0000","last_unstale":"2024-04-26T00:50:40.850071+0000","last_undegraded":"2024-04-26T00:50:40.850071+0000","last_fullsized":"2024-04-26T00:50:40.850071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:54.888616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468580+0000","last_change":"2024-04-26T00:50:39.860246+0000","last_active":"2024-04-26T00:50:41.468580+0000","last_peered":"2024-04-26T00:50:41.468580+0000","last_clean":"2024-04-26T00:50:41.468580+0000","last_became_active":"2024-04-26T00:50:39.859961+0000","last_became_peered":"2024-04-26T00:50:39.859961+0000","last_unstale":"2024-04-26T00:50:41.468580+0000","last_undegraded":"2024-04-26T00:50:41.468580+0000","last_fullsized":"2024-04-26T00:50:41.468580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849532+0000","last_change":"2024-04-26T00:50:38.858626+0000","last_active":"2024-04-26T00:50:40.849532+0000","last_peered":"2024-04-26T00:50:40.849532+0000","last_clean":"2024-04-26T00:50:40.849532+0000","last_became_active":"2024-04-26T00:50:38.858137+0000","last_became_peered":"2024-04-26T00:50:38.858137+0000","last_unstale":"2024-04-26T00:50:40.849532+0000","last_undegraded":"2024-04-26T00:50:40.849532+0000","last_fullsized":"2024-04-26T00:50:40.849532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:38.523333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852229+0000","last_change":"2024-04-26T00:50:38.873856+0000","last_active":"2024-04-26T00:50:40.852229+0000","last_peered":"2024-04-26T00:50:40.852229+0000","last_clean":"2024-04-26T00:50:40.852229+0000","last_became_active":"2024-04-26T00:50:38.873335+0000","last_became_peered":"2024-04-26T00:50:38.873335+0000","last_unstale":"2024-04-26T00:50:40.852229+0000","last_undegraded":"2024-04-26T00:50:40.852229+0000","last_fullsized":"2024-04-26T00:50:40.852229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:50.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465911+0000","last_change":"2024-04-26T00:50:39.848253+0000","last_active":"2024-04-26T00:50:41.465911+0000","last_peered":"2024-04-26T00:50:41.465911+0000","last_clean":"2024-04-26T00:50:41.465911+0000","last_became_active":"2024-04-26T00:50:39.847884+0000","last_became_peered":"2024-04-26T00:50:39.847884+0000","last_unstale":"2024-04-26T00:50:41.465911+0000","last_undegraded":"2024-04-26T00:50:41.465911+0000","last_fullsized":"2024-04-26T00:50:41.465911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851684+0000","last_change":"2024-04-26T00:50:38.845913+0000","last_active":"2024-04-26T00:50:40.851684+0000","last_peered":"2024-04-26T00:50:40.851684+0000","last_clean":"2024-04-26T00:50:40.851684+0000","last_became_active":"2024-04-26T00:50:38.845248+0000","last_became_peered":"2024-04-26T00:50:38.845248+0000","last_unstale":"2024-04-26T00:50:40.851684+0000","last_undegraded":"2024-04-26T00:50:40.851684+0000","last_fullsized":"2024-04-26T00:50:40.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:01:14.839151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465102+0000","last_change":"2024-04-26T00:50:39.862106+0000","last_active":"2024-04-26T00:50:41.465102+0000","last_peered":"2024-04-26T00:50:41.465102+0000","last_clean":"2024-04-26T00:50:41.465102+0000","last_became_active":"2024-04-26T00:50:39.861838+0000","last_became_peered":"2024-04-26T00:50:39.861838+0000","last_unstale":"2024-04-26T00:50:41.465102+0000","last_undegraded":"2024-04-26T00:50:41.465102+0000","last_fullsized":"2024-04-26T00:50:41.465102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852430+0000","last_change":"2024-04-26T00:50:38.869341+0000","last_active":"2024-04-26T00:50:40.852430+0000","last_peered":"2024-04-26T00:50:40.852430+0000","last_clean":"2024-04-26T00:50:40.852430+0000","last_became_active":"2024-04-26T00:50:38.868538+0000","last_became_peered":"2024-04-26T00:50:38.868538+0000","last_unstale":"2024-04-26T00:50:40.852430+0000","last_undegraded":"2024-04-26T00:50:40.852430+0000","last_fullsized":"2024-04-26T00:50:40.852430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:09.233129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850440+0000","last_change":"2024-04-26T00:50:39.838874+0000","last_active":"2024-04-26T00:50:40.850440+0000","last_peered":"2024-04-26T00:50:40.850440+0000","last_clean":"2024-04-26T00:50:40.850440+0000","last_became_active":"2024-04-26T00:50:39.838130+0000","last_became_peered":"2024-04-26T00:50:39.838130+0000","last_unstale":"2024-04-26T00:50:40.850440+0000","last_undegraded":"2024-04-26T00:50:40.850440+0000","last_fullsized":"2024-04-26T00:50:40.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851387+0000","last_change":"2024-04-26T00:50:38.852912+0000","last_active":"2024-04-26T00:50:40.851387+0000","last_peered":"2024-04-26T00:50:40.851387+0000","last_clean":"2024-04-26T00:50:40.851387+0000","last_became_active":"2024-04-26T00:50:38.852425+0000","last_became_peered":"2024-04-26T00:50:38.852425+0000","last_unstale":"2024-04-26T00:50:40.851387+0000","last_undegraded":"2024-04-26T00:50:40.851387+0000","last_fullsized":"2024-04-26T00:50:40.851387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:26.487714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854707+0000","last_change":"2024-04-26T00:50:39.858386+0000","last_active":"2024-04-26T00:50:40.854707+0000","last_peered":"2024-04-26T00:50:40.854707+0000","last_clean":"2024-04-26T00:50:40.854707+0000","last_became_active":"2024-04-26T00:50:39.858084+0000","last_became_peered":"2024-04-26T00:50:39.858084+0000","last_unstale":"2024-04-26T00:50:40.854707+0000","last_undegraded":"2024-04-26T00:50:40.854707+0000","last_fullsized":"2024-04-26T00:50:40.854707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:24.695303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466946+0000","last_change":"2024-04-26T00:50:38.876499+0000","last_active":"2024-04-26T00:50:41.466946+0000","last_peered":"2024-04-26T00:50:41.466946+0000","last_clean":"2024-04-26T00:50:41.466946+0000","last_became_active":"2024-04-26T00:50:38.875568+0000","last_became_peered":"2024-04-26T00:50:38.875568+0000","last_unstale":"2024-04-26T00:50:41.466946+0000","last_undegraded":"2024-04-26T00:50:41.466946+0000","last_fullsized":"2024-04-26T00:50:41.466946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:08.851681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467684+0000","last_change":"2024-04-26T00:50:39.861634+0000","last_active":"2024-04-26T00:50:41.467684+0000","last_peered":"2024-04-26T00:50:41.467684+0000","last_clean":"2024-04-26T00:50:41.467684+0000","last_became_active":"2024-04-26T00:50:39.860919+0000","last_became_peered":"2024-04-26T00:50:39.860919+0000","last_unstale":"2024-04-26T00:50:41.467684+0000","last_undegraded":"2024-04-26T00:50:41.467684+0000","last_fullsized":"2024-04-26T00:50:41.467684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:38.858272+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:38.857911+0000","last_became_peered":"2024-04-26T00:50:38.857911+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:02.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851832+0000","last_change":"2024-04-26T00:50:39.855731+0000","last_active":"2024-04-26T00:50:40.851832+0000","last_peered":"2024-04-26T00:50:40.851832+0000","last_clean":"2024-04-26T00:50:40.851832+0000","last_became_active":"2024-04-26T00:50:39.855401+0000","last_became_peered":"2024-04-26T00:50:39.855401+0000","last_unstale":"2024-04-26T00:50:40.851832+0000","last_undegraded":"2024-04-26T00:50:40.851832+0000","last_fullsized":"2024-04-26T00:50:40.851832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:05.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466079+0000","last_change":"2024-04-26T00:50:38.876014+0000","last_active":"2024-04-26T00:50:41.466079+0000","last_peered":"2024-04-26T00:50:41.466079+0000","last_clean":"2024-04-26T00:50:41.466079+0000","last_became_active":"2024-04-26T00:50:38.875346+0000","last_became_peered":"2024-04-26T00:50:38.875346+0000","last_unstale":"2024-04-26T00:50:41.466079+0000","last_undegraded":"2024-04-26T00:50:41.466079+0000","last_fullsized":"2024-04-26T00:50:41.466079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:25.084153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855287+0000","last_change":"2024-04-26T00:50:39.852334+0000","last_active":"2024-04-26T00:50:40.855287+0000","last_peered":"2024-04-26T00:50:40.855287+0000","last_clean":"2024-04-26T00:50:40.855287+0000","last_became_active":"2024-04-26T00:50:39.849126+0000","last_became_peered":"2024-04-26T00:50:39.849126+0000","last_unstale":"2024-04-26T00:50:40.855287+0000","last_undegraded":"2024-04-26T00:50:40.855287+0000","last_fullsized":"2024-04-26T00:50:40.855287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:55.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464952+0000","last_change":"2024-04-26T00:50:38.879815+0000","last_active":"2024-04-26T00:50:41.464952+0000","last_peered":"2024-04-26T00:50:41.464952+0000","last_clean":"2024-04-26T00:50:41.464952+0000","last_became_active":"2024-04-26T00:50:38.876392+0000","last_became_peered":"2024-04-26T00:50:38.876392+0000","last_unstale":"2024-04-26T00:50:41.464952+0000","last_undegraded":"2024-04-26T00:50:41.464952+0000","last_fullsized":"2024-04-26T00:50:41.464952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:07.680535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469056+0000","last_change":"2024-04-26T00:50:39.862953+0000","last_active":"2024-04-26T00:50:41.469056+0000","last_peered":"2024-04-26T00:50:41.469056+0000","last_clean":"2024-04-26T00:50:41.469056+0000","last_became_active":"2024-04-26T00:50:39.862133+0000","last_became_peered":"2024-04-26T00:50:39.862133+0000","last_unstale":"2024-04-26T00:50:41.469056+0000","last_undegraded":"2024-04-26T00:50:41.469056+0000","last_fullsized":"2024-04-26T00:50:41.469056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464665+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:41.464665+0000","last_peered":"2024-04-26T00:50:41.464665+0000","last_clean":"2024-04-26T00:50:41.464665+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:41.464665+0000","last_undegraded":"2024-04-26T00:50:41.464665+0000","last_fullsized":"2024-04-26T00:50:41.464665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851020+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:40.851020+0000","last_peered":"2024-04-26T00:50:40.851020+0000","last_clean":"2024-04-26T00:50:40.851020+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:40.851020+0000","last_undegraded":"2024-04-26T00:50:40.851020+0000","last_fullsized":"2024-04-26T00:50:40.851020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467042+0000","last_change":"2024-04-26T00:50:38.866703+0000","last_active":"2024-04-26T00:50:41.467042+0000","last_peered":"2024-04-26T00:50:41.467042+0000","last_clean":"2024-04-26T00:50:41.467042+0000","last_became_active":"2024-04-26T00:50:38.866123+0000","last_became_peered":"2024-04-26T00:50:38.866123+0000","last_unstale":"2024-04-26T00:50:41.467042+0000","last_undegraded":"2024-04-26T00:50:41.467042+0000","last_fullsized":"2024-04-26T00:50:41.467042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:09.927849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852406+0000","last_change":"2024-04-26T00:50:39.859004+0000","last_active":"2024-04-26T00:50:40.852406+0000","last_peered":"2024-04-26T00:50:40.852406+0000","last_clean":"2024-04-26T00:50:40.852406+0000","last_became_active":"2024-04-26T00:50:39.858536+0000","last_became_peered":"2024-04-26T00:50:39.858536+0000","last_unstale":"2024-04-26T00:50:40.852406+0000","last_undegraded":"2024-04-26T00:50:40.852406+0000","last_fullsized":"2024-04-26T00:50:40.852406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:44.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849761+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:40.849761+0000","last_peered":"2024-04-26T00:50:40.849761+0000","last_clean":"2024-04-26T00:50:40.849761+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:40.849761+0000","last_undegraded":"2024-04-26T00:50:40.849761+0000","last_fullsized":"2024-04-26T00:50:40.849761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465609+0000","last_change":"2024-04-26T00:50:38.862050+0000","last_active":"2024-04-26T00:50:41.465609+0000","last_peered":"2024-04-26T00:50:41.465609+0000","last_clean":"2024-04-26T00:50:41.465609+0000","last_became_active":"2024-04-26T00:50:38.861329+0000","last_became_peered":"2024-04-26T00:50:38.861329+0000","last_unstale":"2024-04-26T00:50:41.465609+0000","last_undegraded":"2024-04-26T00:50:41.465609+0000","last_fullsized":"2024-04-26T00:50:41.465609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:19.670169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466871+0000","last_change":"2024-04-26T00:50:39.859556+0000","last_active":"2024-04-26T00:50:41.466871+0000","last_peered":"2024-04-26T00:50:41.466871+0000","last_clean":"2024-04-26T00:50:41.466871+0000","last_became_active":"2024-04-26T00:50:39.858347+0000","last_became_peered":"2024-04-26T00:50:39.858347+0000","last_unstale":"2024-04-26T00:50:41.466871+0000","last_undegraded":"2024-04-26T00:50:41.466871+0000","last_fullsized":"2024-04-26T00:50:41.466871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854116+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:40.854116+0000","last_peered":"2024-04-26T00:50:40.854116+0000","last_clean":"2024-04-26T00:50:40.854116+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:40.854116+0000","last_undegraded":"2024-04-26T00:50:40.854116+0000","last_fullsized":"2024-04-26T00:50:40.854116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464225+0000","last_change":"2024-04-26T00:50:38.864670+0000","last_active":"2024-04-26T00:50:41.464225+0000","last_peered":"2024-04-26T00:50:41.464225+0000","last_clean":"2024-04-26T00:50:41.464225+0000","last_became_active":"2024-04-26T00:50:38.861543+0000","last_became_peered":"2024-04-26T00:50:38.861543+0000","last_unstale":"2024-04-26T00:50:41.464225+0000","last_undegraded":"2024-04-26T00:50:41.464225+0000","last_fullsized":"2024-04-26T00:50:41.464225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469153+0000","last_change":"2024-04-26T00:50:39.862379+0000","last_active":"2024-04-26T00:50:41.469153+0000","last_peered":"2024-04-26T00:50:41.469153+0000","last_clean":"2024-04-26T00:50:41.469153+0000","last_became_active":"2024-04-26T00:50:39.860598+0000","last_became_peered":"2024-04-26T00:50:39.860598+0000","last_unstale":"2024-04-26T00:50:41.469153+0000","last_undegraded":"2024-04-26T00:50:41.469153+0000","last_fullsized":"2024-04-26T00:50:41.469153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850966+0000","last_change":"2024-04-26T00:50:38.857970+0000","last_active":"2024-04-26T00:50:40.850966+0000","last_peered":"2024-04-26T00:50:40.850966+0000","last_clean":"2024-04-26T00:50:40.850966+0000","last_became_active":"2024-04-26T00:50:38.857664+0000","last_became_peered":"2024-04-26T00:50:38.857664+0000","last_unstale":"2024-04-26T00:50:40.850966+0000","last_undegraded":"2024-04-26T00:50:40.850966+0000","last_fullsized":"2024-04-26T00:50:40.850966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.406470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467834+0000","last_change":"2024-04-26T00:50:39.868652+0000","last_active":"2024-04-26T00:50:41.467834+0000","last_peered":"2024-04-26T00:50:41.467834+0000","last_clean":"2024-04-26T00:50:41.467834+0000","last_became_active":"2024-04-26T00:50:39.868244+0000","last_became_peered":"2024-04-26T00:50:39.868244+0000","last_unstale":"2024-04-26T00:50:41.467834+0000","last_undegraded":"2024-04-26T00:50:41.467834+0000","last_fullsized":"2024-04-26T00:50:41.467834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852702+0000","last_change":"2024-04-26T00:50:38.868988+0000","last_active":"2024-04-26T00:50:40.852702+0000","last_peered":"2024-04-26T00:50:40.852702+0000","last_clean":"2024-04-26T00:50:40.852702+0000","last_became_active":"2024-04-26T00:50:38.868419+0000","last_became_peered":"2024-04-26T00:50:38.868419+0000","last_unstale":"2024-04-26T00:50:40.852702+0000","last_undegraded":"2024-04-26T00:50:40.852702+0000","last_fullsized":"2024-04-26T00:50:40.852702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.246593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468295+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:41.468295+0000","last_peered":"2024-04-26T00:50:41.468295+0000","last_clean":"2024-04-26T00:50:41.468295+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:41.468295+0000","last_undegraded":"2024-04-26T00:50:41.468295+0000","last_fullsized":"2024-04-26T00:50:41.468295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464953+0000","last_change":"2024-04-26T00:50:39.855312+0000","last_active":"2024-04-26T00:50:41.464953+0000","last_peered":"2024-04-26T00:50:41.464953+0000","last_clean":"2024-04-26T00:50:41.464953+0000","last_became_active":"2024-04-26T00:50:39.853775+0000","last_became_peered":"2024-04-26T00:50:39.853775+0000","last_unstale":"2024-04-26T00:50:41.464953+0000","last_undegraded":"2024-04-26T00:50:41.464953+0000","last_fullsized":"2024-04-26T00:50:41.464953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468158+0000","last_change":"2024-04-26T00:50:38.863255+0000","last_active":"2024-04-26T00:50:41.468158+0000","last_peered":"2024-04-26T00:50:41.468158+0000","last_clean":"2024-04-26T00:50:41.468158+0000","last_became_active":"2024-04-26T00:50:38.861925+0000","last_became_peered":"2024-04-26T00:50:38.861925+0000","last_unstale":"2024-04-26T00:50:41.468158+0000","last_undegraded":"2024-04-26T00:50:41.468158+0000","last_fullsized":"2024-04-26T00:50:41.468158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:37.293965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852840+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:40.852840+0000","last_peered":"2024-04-26T00:50:40.852840+0000","last_clean":"2024-04-26T00:50:40.852840+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:40.852840+0000","last_undegraded":"2024-04-26T00:50:40.852840+0000","last_fullsized":"2024-04-26T00:50:40.852840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467285+0000","last_change":"2024-04-26T00:50:39.859688+0000","last_active":"2024-04-26T00:50:41.467285+0000","last_peered":"2024-04-26T00:50:41.467285+0000","last_clean":"2024-04-26T00:50:41.467285+0000","last_became_active":"2024-04-26T00:50:39.859353+0000","last_became_peered":"2024-04-26T00:50:39.859353+0000","last_unstale":"2024-04-26T00:50:41.467285+0000","last_undegraded":"2024-04-26T00:50:41.467285+0000","last_fullsized":"2024-04-26T00:50:41.467285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468552+0000","last_change":"2024-04-26T00:50:38.876486+0000","last_active":"2024-04-26T00:50:41.468552+0000","last_peered":"2024-04-26T00:50:41.468552+0000","last_clean":"2024-04-26T00:50:41.468552+0000","last_became_active":"2024-04-26T00:50:38.875909+0000","last_became_peered":"2024-04-26T00:50:38.875909+0000","last_unstale":"2024-04-26T00:50:41.468552+0000","last_undegraded":"2024-04-26T00:50:41.468552+0000","last_fullsized":"2024-04-26T00:50:41.468552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:40:21.077132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469439+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:41.469439+0000","last_peered":"2024-04-26T00:50:41.469439+0000","last_clean":"2024-04-26T00:50:41.469439+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:41.469439+0000","last_undegraded":"2024-04-26T00:50:41.469439+0000","last_fullsized":"2024-04-26T00:50:41.469439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464450+0000","last_change":"2024-04-26T00:50:39.848704+0000","last_active":"2024-04-26T00:50:41.464450+0000","last_peered":"2024-04-26T00:50:41.464450+0000","last_clean":"2024-04-26T00:50:41.464450+0000","last_became_active":"2024-04-26T00:50:39.848429+0000","last_became_peered":"2024-04-26T00:50:39.848429+0000","last_unstale":"2024-04-26T00:50:41.464450+0000","last_undegraded":"2024-04-26T00:50:41.464450+0000","last_fullsized":"2024-04-26T00:50:41.464450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:40.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.837302+0000","last_change":"2024-04-26T00:50:38.867565+0000","last_active":"2024-04-26T00:50:41.837302+0000","last_peered":"2024-04-26T00:50:41.837302+0000","last_clean":"2024-04-26T00:50:41.837302+0000","last_became_active":"2024-04-26T00:50:38.866728+0000","last_became_peered":"2024-04-26T00:50:38.866728+0000","last_unstale":"2024-04-26T00:50:41.837302+0000","last_undegraded":"2024-04-26T00:50:41.837302+0000","last_fullsized":"2024-04-26T00:50:41.837302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:23.691727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852376+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:40.852376+0000","last_peered":"2024-04-26T00:50:40.852376+0000","last_clean":"2024-04-26T00:50:40.852376+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:40.852376+0000","last_undegraded":"2024-04-26T00:50:40.852376+0000","last_fullsized":"2024-04-26T00:50:40.852376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854095+0000","last_change":"2024-04-26T00:50:39.856903+0000","last_active":"2024-04-26T00:50:40.854095+0000","last_peered":"2024-04-26T00:50:40.854095+0000","last_clean":"2024-04-26T00:50:40.854095+0000","last_became_active":"2024-04-26T00:50:39.856609+0000","last_became_peered":"2024-04-26T00:50:39.856609+0000","last_unstale":"2024-04-26T00:50:40.854095+0000","last_undegraded":"2024-04-26T00:50:40.854095+0000","last_fullsized":"2024-04-26T00:50:40.854095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:12.129353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854504+0000","last_change":"2024-04-26T00:50:39.857946+0000","last_active":"2024-04-26T00:50:40.854504+0000","last_peered":"2024-04-26T00:50:40.854504+0000","last_clean":"2024-04-26T00:50:40.854504+0000","last_became_active":"2024-04-26T00:50:39.857653+0000","last_became_peered":"2024-04-26T00:50:39.857653+0000","last_unstale":"2024-04-26T00:50:40.854504+0000","last_undegraded":"2024-04-26T00:50:40.854504+0000","last_fullsized":"2024-04-26T00:50:40.854504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:40.181948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851322+0000","last_change":"2024-04-26T00:50:38.846157+0000","last_active":"2024-04-26T00:50:40.851322+0000","last_peered":"2024-04-26T00:50:40.851322+0000","last_clean":"2024-04-26T00:50:40.851322+0000","last_became_active":"2024-04-26T00:50:38.845728+0000","last_became_peered":"2024-04-26T00:50:38.845728+0000","last_unstale":"2024-04-26T00:50:40.851322+0000","last_undegraded":"2024-04-26T00:50:40.851322+0000","last_fullsized":"2024-04-26T00:50:40.851322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465860+0000","last_change":"2024-04-26T00:50:39.851993+0000","last_active":"2024-04-26T00:50:41.465860+0000","last_peered":"2024-04-26T00:50:41.465860+0000","last_clean":"2024-04-26T00:50:41.465860+0000","last_became_active":"2024-04-26T00:50:39.851385+0000","last_became_peered":"2024-04-26T00:50:39.851385+0000","last_unstale":"2024-04-26T00:50:41.465860+0000","last_undegraded":"2024-04-26T00:50:41.465860+0000","last_fullsized":"2024-04-26T00:50:41.465860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855046+0000","last_change":"2024-04-26T00:50:38.859885+0000","last_active":"2024-04-26T00:50:40.855046+0000","last_peered":"2024-04-26T00:50:40.855046+0000","last_clean":"2024-04-26T00:50:40.855046+0000","last_became_active":"2024-04-26T00:50:38.858568+0000","last_became_peered":"2024-04-26T00:50:38.858568+0000","last_unstale":"2024-04-26T00:50:40.855046+0000","last_undegraded":"2024-04-26T00:50:40.855046+0000","last_fullsized":"2024-04-26T00:50:40.855046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851422+0000","last_change":"2024-04-26T00:50:38.866142+0000","last_active":"2024-04-26T00:50:40.851422+0000","last_peered":"2024-04-26T00:50:40.851422+0000","last_clean":"2024-04-26T00:50:40.851422+0000","last_became_active":"2024-04-26T00:50:38.865557+0000","last_became_peered":"2024-04-26T00:50:38.865557+0000","last_unstale":"2024-04-26T00:50:40.851422+0000","last_undegraded":"2024-04-26T00:50:40.851422+0000","last_fullsized":"2024-04-26T00:50:40.851422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:31.035091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466248+0000","last_change":"2024-04-26T00:50:39.854303+0000","last_active":"2024-04-26T00:50:41.466248+0000","last_peered":"2024-04-26T00:50:41.466248+0000","last_clean":"2024-04-26T00:50:41.466248+0000","last_became_active":"2024-04-26T00:50:39.852216+0000","last_became_peered":"2024-04-26T00:50:39.852216+0000","last_unstale":"2024-04-26T00:50:41.466248+0000","last_undegraded":"2024-04-26T00:50:41.466248+0000","last_fullsized":"2024-04-26T00:50:41.466248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469542+0000","last_change":"2024-04-26T00:50:38.867859+0000","last_active":"2024-04-26T00:50:41.469542+0000","last_peered":"2024-04-26T00:50:41.469542+0000","last_clean":"2024-04-26T00:50:41.469542+0000","last_became_active":"2024-04-26T00:50:38.866771+0000","last_became_peered":"2024-04-26T00:50:38.866771+0000","last_unstale":"2024-04-26T00:50:41.469542+0000","last_undegraded":"2024-04-26T00:50:41.469542+0000","last_fullsized":"2024-04-26T00:50:41.469542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464008+0000","last_change":"2024-04-26T00:50:39.851991+0000","last_active":"2024-04-26T00:50:41.464008+0000","last_peered":"2024-04-26T00:50:41.464008+0000","last_clean":"2024-04-26T00:50:41.464008+0000","last_became_active":"2024-04-26T00:50:39.851680+0000","last_became_peered":"2024-04-26T00:50:39.851680+0000","last_unstale":"2024-04-26T00:50:41.464008+0000","last_undegraded":"2024-04-26T00:50:41.464008+0000","last_fullsized":"2024-04-26T00:50:41.464008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:51.385973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852269+0000","last_change":"2024-04-26T00:50:39.859275+0000","last_active":"2024-04-26T00:50:40.852269+0000","last_peered":"2024-04-26T00:50:40.852269+0000","last_clean":"2024-04-26T00:50:40.852269+0000","last_became_active":"2024-04-26T00:50:39.858722+0000","last_became_peered":"2024-04-26T00:50:39.858722+0000","last_unstale":"2024-04-26T00:50:40.852269+0000","last_undegraded":"2024-04-26T00:50:40.852269+0000","last_fullsized":"2024-04-26T00:50:40.852269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:43.277704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464709+0000","last_change":"2024-04-26T00:50:38.876692+0000","last_active":"2024-04-26T00:50:41.464709+0000","last_peered":"2024-04-26T00:50:41.464709+0000","last_clean":"2024-04-26T00:50:41.464709+0000","last_became_active":"2024-04-26T00:50:38.875789+0000","last_became_peered":"2024-04-26T00:50:38.875789+0000","last_unstale":"2024-04-26T00:50:41.464709+0000","last_undegraded":"2024-04-26T00:50:41.464709+0000","last_fullsized":"2024-04-26T00:50:41.464709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468966+0000","last_change":"2024-04-26T00:50:39.853149+0000","last_active":"2024-04-26T00:50:41.468966+0000","last_peered":"2024-04-26T00:50:41.468966+0000","last_clean":"2024-04-26T00:50:41.468966+0000","last_became_active":"2024-04-26T00:50:39.852980+0000","last_became_peered":"2024-04-26T00:50:39.852980+0000","last_unstale":"2024-04-26T00:50:41.468966+0000","last_undegraded":"2024-04-26T00:50:41.468966+0000","last_fullsized":"2024-04-26T00:50:41.468966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465368+0000","last_change":"2024-04-26T00:50:38.868567+0000","last_active":"2024-04-26T00:50:41.465368+0000","last_peered":"2024-04-26T00:50:41.465368+0000","last_clean":"2024-04-26T00:50:41.465368+0000","last_became_active":"2024-04-26T00:50:38.867948+0000","last_became_peered":"2024-04-26T00:50:38.867948+0000","last_unstale":"2024-04-26T00:50:41.465368+0000","last_undegraded":"2024-04-26T00:50:41.465368+0000","last_fullsized":"2024-04-26T00:50:41.465368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:11.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466691+0000","last_change":"2024-04-26T00:50:39.860208+0000","last_active":"2024-04-26T00:50:41.466691+0000","last_peered":"2024-04-26T00:50:41.466691+0000","last_clean":"2024-04-26T00:50:41.466691+0000","last_became_active":"2024-04-26T00:50:39.859876+0000","last_became_peered":"2024-04-26T00:50:39.859876+0000","last_unstale":"2024-04-26T00:50:41.466691+0000","last_undegraded":"2024-04-26T00:50:41.466691+0000","last_fullsized":"2024-04-26T00:50:41.466691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850749+0000","last_change":"2024-04-26T00:50:38.866484+0000","last_active":"2024-04-26T00:50:40.850749+0000","last_peered":"2024-04-26T00:50:40.850749+0000","last_clean":"2024-04-26T00:50:40.850749+0000","last_became_active":"2024-04-26T00:50:38.865840+0000","last_became_peered":"2024-04-26T00:50:38.865840+0000","last_unstale":"2024-04-26T00:50:40.850749+0000","last_undegraded":"2024-04-26T00:50:40.850749+0000","last_fullsized":"2024-04-26T00:50:40.850749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:37.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855141+0000","last_change":"2024-04-26T00:50:39.866945+0000","last_active":"2024-04-26T00:50:40.855141+0000","last_peered":"2024-04-26T00:50:40.855141+0000","last_clean":"2024-04-26T00:50:40.855141+0000","last_became_active":"2024-04-26T00:50:39.866257+0000","last_became_peered":"2024-04-26T00:50:39.866257+0000","last_unstale":"2024-04-26T00:50:40.855141+0000","last_undegraded":"2024-04-26T00:50:40.855141+0000","last_fullsized":"2024-04-26T00:50:40.855141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:07.845148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466077+0000","last_change":"2024-04-26T00:50:38.870006+0000","last_active":"2024-04-26T00:50:41.466077+0000","last_peered":"2024-04-26T00:50:41.466077+0000","last_clean":"2024-04-26T00:50:41.466077+0000","last_became_active":"2024-04-26T00:50:38.869408+0000","last_became_peered":"2024-04-26T00:50:38.869408+0000","last_unstale":"2024-04-26T00:50:41.466077+0000","last_undegraded":"2024-04-26T00:50:41.466077+0000","last_fullsized":"2024-04-26T00:50:41.466077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:20.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854580+0000","last_change":"2024-04-26T00:50:39.867012+0000","last_active":"2024-04-26T00:50:40.854580+0000","last_peered":"2024-04-26T00:50:40.854580+0000","last_clean":"2024-04-26T00:50:40.854580+0000","last_became_active":"2024-04-26T00:50:39.866002+0000","last_became_peered":"2024-04-26T00:50:39.866002+0000","last_unstale":"2024-04-26T00:50:40.854580+0000","last_undegraded":"2024-04-26T00:50:40.854580+0000","last_fullsized":"2024-04-26T00:50:40.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:38.297542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467910+0000","last_change":"2024-04-26T00:50:38.868711+0000","last_active":"2024-04-26T00:50:41.467910+0000","last_peered":"2024-04-26T00:50:41.467910+0000","last_clean":"2024-04-26T00:50:41.467910+0000","last_became_active":"2024-04-26T00:50:38.868002+0000","last_became_peered":"2024-04-26T00:50:38.868002+0000","last_unstale":"2024-04-26T00:50:41.467910+0000","last_undegraded":"2024-04-26T00:50:41.467910+0000","last_fullsized":"2024-04-26T00:50:41.467910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:39.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850433+0000","last_change":"2024-04-26T00:50:39.857039+0000","last_active":"2024-04-26T00:50:40.850433+0000","last_peered":"2024-04-26T00:50:40.850433+0000","last_clean":"2024-04-26T00:50:40.850433+0000","last_became_active":"2024-04-26T00:50:39.856666+0000","last_became_peered":"2024-04-26T00:50:39.856666+0000","last_unstale":"2024-04-26T00:50:40.850433+0000","last_undegraded":"2024-04-26T00:50:40.850433+0000","last_fullsized":"2024-04-26T00:50:40.850433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852110+0000","last_change":"2024-04-26T00:50:38.849900+0000","last_active":"2024-04-26T00:50:40.852110+0000","last_peered":"2024-04-26T00:50:40.852110+0000","last_clean":"2024-04-26T00:50:40.852110+0000","last_became_active":"2024-04-26T00:50:38.849354+0000","last_became_peered":"2024-04-26T00:50:38.849354+0000","last_unstale":"2024-04-26T00:50:40.852110+0000","last_undegraded":"2024-04-26T00:50:40.852110+0000","last_fullsized":"2024-04-26T00:50:40.852110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:38.438162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467384+0000","last_change":"2024-04-26T00:50:39.863655+0000","last_active":"2024-04-26T00:50:41.467384+0000","last_peered":"2024-04-26T00:50:41.467384+0000","last_clean":"2024-04-26T00:50:41.467384+0000","last_became_active":"2024-04-26T00:50:39.863378+0000","last_became_peered":"2024-04-26T00:50:39.863378+0000","last_unstale":"2024-04-26T00:50:41.467384+0000","last_undegraded":"2024-04-26T00:50:41.467384+0000","last_fullsized":"2024-04-26T00:50:41.467384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467256+0000","last_change":"2024-04-26T00:50:38.876385+0000","last_active":"2024-04-26T00:50:41.467256+0000","last_peered":"2024-04-26T00:50:41.467256+0000","last_clean":"2024-04-26T00:50:41.467256+0000","last_became_active":"2024-04-26T00:50:38.875458+0000","last_became_peered":"2024-04-26T00:50:38.875458+0000","last_unstale":"2024-04-26T00:50:41.467256+0000","last_undegraded":"2024-04-26T00:50:41.467256+0000","last_fullsized":"2024-04-26T00:50:41.467256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849703+0000","last_change":"2024-04-26T00:50:39.847368+0000","last_active":"2024-04-26T00:50:40.849703+0000","last_peered":"2024-04-26T00:50:40.849703+0000","last_clean":"2024-04-26T00:50:40.849703+0000","last_became_active":"2024-04-26T00:50:39.845961+0000","last_became_peered":"2024-04-26T00:50:39.845961+0000","last_unstale":"2024-04-26T00:50:40.849703+0000","last_undegraded":"2024-04-26T00:50:40.849703+0000","last_fullsized":"2024-04-26T00:50:40.849703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469540+0000","last_change":"2024-04-26T00:50:38.873696+0000","last_active":"2024-04-26T00:50:41.469540+0000","last_peered":"2024-04-26T00:50:41.469540+0000","last_clean":"2024-04-26T00:50:41.469540+0000","last_became_active":"2024-04-26T00:50:38.873136+0000","last_became_peered":"2024-04-26T00:50:38.873136+0000","last_unstale":"2024-04-26T00:50:41.469540+0000","last_undegraded":"2024-04-26T00:50:41.469540+0000","last_fullsized":"2024-04-26T00:50:41.469540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:19.993664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":656236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":654556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:45.822 INFO:tasks.ceph.mds.b.smithi188.stderr:2024-04-26T00:50:45.816+0000 7fe7b01ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T00:50:48.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 Processor -- start 2024-04-26T00:50:48.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 -- start start 2024-04-26T00:50:48.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7560138390 0x7f75600723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7560073220 0x7f75600a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f75600b7890 con 0x7f7560073220 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f75600a7f10 con 0x7f7560138390 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f75666e2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7560072aa0 con 0x7f75600b74b0 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f755ffff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7560073220 0x7f75600a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f755ffff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60620/0 (socket says 172.21.15.6:60620) 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f755ffff640 1 -- 172.21.15.6:0/2639716518 learned_addr learned my addr 172.21.15.6:0/2639716518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f755f7fe640 1 --2- 172.21.15.6:0/2639716518 >> v2:172.21.15.188:3300/0 conn(0x7f7560138390 0x7f75600723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 -- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 msgr2=0x7f7560071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 -- 172.21.15.6:0/2639716518 >> v2:172.21.15.188:3300/0 conn(0x7f7560138390 msgr2=0x7f75600723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 --2- 172.21.15.6:0/2639716518 >> v2:172.21.15.188:3300/0 conn(0x7f7560138390 0x7f75600723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f7564c7f640 1 -- 172.21.15.6:0/2639716518 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7560072d60 con 0x7f7560073220 2024-04-26T00:50:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.516+0000 7f755ffff640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:48.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560073220 0x7f75600a55c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f756006e9f0 tx=0x7f755801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32572868a6dfdea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755effd640 1 -- 172.21.15.6:0/2639716518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580b2070 con 0x7f7560073220 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755effd640 1 -- 172.21.15.6:0/2639716518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580a58a0 con 0x7f7560073220 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755effd640 1 -- 172.21.15.6:0/2639716518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580a5c70 con 0x7f7560073220 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560073220 msgr2=0x7f75600a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560073220 0x7f75600a55c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f756006e9f0 tx=0x7f755801c910 comp rx=0 tx=0).stop 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/2639716518 shutdown_connections 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560073220 0x7f75600a55c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- 172.21.15.6:0/2639716518 >> v2:172.21.15.188:3300/0 conn(0x7f7560138390 0x7f75600723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- 172.21.15.6:0/2639716518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75600b74b0 0x7f7560071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/2639716518 >> 172.21.15.6:0/2639716518 conn(0x7f756006e230 msgr2=0x7f75600b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/2639716518 shutdown_connections 2024-04-26T00:50:48.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/2639716518 wait complete. 2024-04-26T00:50:48.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 Processor -- start 2024-04-26T00:50:48.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- start start 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 0x7f75600a3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75600b74b0 0x7f75600b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7560134f10 con 0x7f7560138390 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7560134d90 con 0x7f75600b74b0 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7560135090 con 0x7f7560073220 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755ffff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 0x7f75600a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37336/0 (socket says 172.21.15.6:37336) 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 -- 172.21.15.6:0/1713056250 learned_addr learned my addr 172.21.15.6:0/1713056250 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:48.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755f7fe640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75600b74b0 0x7f75600b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 -- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 msgr2=0x7f75600a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 0x7f75600a3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 -- 172.21.15.6:0/1713056250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75600b74b0 msgr2=0x7f75600b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75600b74b0 0x7f75600b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 -- 172.21.15.6:0/1713056250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75601ded70 con 0x7f7560138390 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755ffff640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 0x7f75600a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f7564c7f640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75580b0040 tx=0x7f7560135380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580b2040 con 0x7f7560138390 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580ad440 con 0x7f7560138390 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75601df030 con 0x7f7560138390 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580ad830 con 0x7f7560138390 2024-04-26T00:50:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.520+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75600b3d10 con 0x7f7560138390 2024-04-26T00:50:48.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756006db70 con 0x7f7560138390 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f75580c0020 con 0x7f7560138390 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 0x7f754c09b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755ffff640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 0x7f754c09b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f755815d1f0 con 0x7f7560138390 2024-04-26T00:50:48.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.524+0000 7f755ffff640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 0x7f754c09b8b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7550009630 tx=0x7f7550009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.528+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f75580c7020 con 0x7f7560138390 2024-04-26T00:50:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.684+0000 7f75666e2640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.684+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f756014c400 con 0x7f754c0993f0 2024-04-26T00:50:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.696+0000 7f755cff9640 1 -- 172.21.15.6:0/1713056250 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268541 (secure 0 0 0) 0x7f756014c400 con 0x7f754c0993f0 2024-04-26T00:50:48.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.696+0000 7f755cff9640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:48.710 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:48.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 10 mgrc shutdown 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 msgr2=0x7f754c09b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 0x7f754c09b8b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7550009630 tx=0x7f7550009240 comp rx=0 tx=0).stop 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 msgr2=0x7f75600b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75580b0040 tx=0x7f7560135380 comp rx=0 tx=0).stop 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 shutdown_connections 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f754c0993f0 0x7f754c09b8b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7560138390 0x7f75600b0d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75600b74b0 0x7f75600b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 --2- 172.21.15.6:0/1713056250 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7560073220 0x7f75600a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 >> 172.21.15.6:0/1713056250 conn(0x7f756006e230 msgr2=0x7f75600a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 shutdown_connections 2024-04-26T00:50:48.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.700+0000 7f75666e2640 1 -- 172.21.15.6:0/1713056250 wait complete. 2024-04-26T00:50:48.728 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T00:50:48.257228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114192,"kb_used_data":1944,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373168,"statfs":{"total":386547056640,"available":386430124032,"internally_reserved":0,"allocated":1990656,"data_stored":1439892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.429147"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855209+0000","last_change":"2024-04-26T00:50:39.864060+0000","last_active":"2024-04-26T00:50:40.855209+0000","last_peered":"2024-04-26T00:50:40.855209+0000","last_clean":"2024-04-26T00:50:40.855209+0000","last_became_active":"2024-04-26T00:50:39.863233+0000","last_became_peered":"2024-04-26T00:50:39.863233+0000","last_unstale":"2024-04-26T00:50:40.855209+0000","last_undegraded":"2024-04-26T00:50:40.855209+0000","last_fullsized":"2024-04-26T00:50:40.855209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.858910+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858358+0000","last_became_peered":"2024-04-26T00:50:39.858358+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.333493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.859022+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858634+0000","last_became_peered":"2024-04-26T00:50:39.858634+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:01:18.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464955+0000","last_change":"2024-04-26T00:50:39.861410+0000","last_active":"2024-04-26T00:50:41.464955+0000","last_peered":"2024-04-26T00:50:41.464955+0000","last_clean":"2024-04-26T00:50:41.464955+0000","last_became_active":"2024-04-26T00:50:39.860413+0000","last_became_peered":"2024-04-26T00:50:39.860413+0000","last_unstale":"2024-04-26T00:50:41.464955+0000","last_undegraded":"2024-04-26T00:50:41.464955+0000","last_fullsized":"2024-04-26T00:50:41.464955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465774+0000","last_change":"2024-04-26T00:50:39.854723+0000","last_active":"2024-04-26T00:50:41.465774+0000","last_peered":"2024-04-26T00:50:41.465774+0000","last_clean":"2024-04-26T00:50:41.465774+0000","last_became_active":"2024-04-26T00:50:39.854507+0000","last_became_peered":"2024-04-26T00:50:39.854507+0000","last_unstale":"2024-04-26T00:50:41.465774+0000","last_undegraded":"2024-04-26T00:50:41.465774+0000","last_fullsized":"2024-04-26T00:50:41.465774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:58.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465520+0000","last_change":"2024-04-26T00:50:39.848920+0000","last_active":"2024-04-26T00:50:41.465520+0000","last_peered":"2024-04-26T00:50:41.465520+0000","last_clean":"2024-04-26T00:50:41.465520+0000","last_became_active":"2024-04-26T00:50:39.848576+0000","last_became_peered":"2024-04-26T00:50:39.848576+0000","last_unstale":"2024-04-26T00:50:41.465520+0000","last_undegraded":"2024-04-26T00:50:41.465520+0000","last_fullsized":"2024-04-26T00:50:41.465520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:00.751396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465029+0000","last_change":"2024-04-26T00:50:39.848389+0000","last_active":"2024-04-26T00:50:41.465029+0000","last_peered":"2024-04-26T00:50:41.465029+0000","last_clean":"2024-04-26T00:50:41.465029+0000","last_became_active":"2024-04-26T00:50:39.847874+0000","last_became_peered":"2024-04-26T00:50:39.847874+0000","last_unstale":"2024-04-26T00:50:41.465029+0000","last_undegraded":"2024-04-26T00:50:41.465029+0000","last_fullsized":"2024-04-26T00:50:41.465029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:28.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849307+0000","last_change":"2024-04-26T00:50:39.863022+0000","last_active":"2024-04-26T00:50:40.849307+0000","last_peered":"2024-04-26T00:50:40.849307+0000","last_clean":"2024-04-26T00:50:40.849307+0000","last_became_active":"2024-04-26T00:50:39.862653+0000","last_became_peered":"2024-04-26T00:50:39.862653+0000","last_unstale":"2024-04-26T00:50:40.849307+0000","last_undegraded":"2024-04-26T00:50:40.849307+0000","last_fullsized":"2024-04-26T00:50:40.849307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855363+0000","last_change":"2024-04-26T00:50:39.864364+0000","last_active":"2024-04-26T00:50:40.855363+0000","last_peered":"2024-04-26T00:50:40.855363+0000","last_clean":"2024-04-26T00:50:40.855363+0000","last_became_active":"2024-04-26T00:50:39.863765+0000","last_became_peered":"2024-04-26T00:50:39.863765+0000","last_unstale":"2024-04-26T00:50:40.855363+0000","last_undegraded":"2024-04-26T00:50:40.855363+0000","last_fullsized":"2024-04-26T00:50:40.855363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:03.262591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468765+0000","last_change":"2024-04-26T00:50:39.860856+0000","last_active":"2024-04-26T00:50:41.468765+0000","last_peered":"2024-04-26T00:50:41.468765+0000","last_clean":"2024-04-26T00:50:41.468765+0000","last_became_active":"2024-04-26T00:50:39.860592+0000","last_became_peered":"2024-04-26T00:50:39.860592+0000","last_unstale":"2024-04-26T00:50:41.468765+0000","last_undegraded":"2024-04-26T00:50:41.468765+0000","last_fullsized":"2024-04-26T00:50:41.468765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468466+0000","last_change":"2024-04-26T00:50:39.854576+0000","last_active":"2024-04-26T00:50:41.468466+0000","last_peered":"2024-04-26T00:50:41.468466+0000","last_clean":"2024-04-26T00:50:41.468466+0000","last_became_active":"2024-04-26T00:50:39.854290+0000","last_became_peered":"2024-04-26T00:50:39.854290+0000","last_unstale":"2024-04-26T00:50:41.468466+0000","last_undegraded":"2024-04-26T00:50:41.468466+0000","last_fullsized":"2024-04-26T00:50:41.468466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855221+0000","last_change":"2024-04-26T00:50:39.867495+0000","last_active":"2024-04-26T00:50:40.855221+0000","last_peered":"2024-04-26T00:50:40.855221+0000","last_clean":"2024-04-26T00:50:40.855221+0000","last_became_active":"2024-04-26T00:50:39.866525+0000","last_became_peered":"2024-04-26T00:50:39.866525+0000","last_unstale":"2024-04-26T00:50:40.855221+0000","last_undegraded":"2024-04-26T00:50:40.855221+0000","last_fullsized":"2024-04-26T00:50:40.855221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854314+0000","last_change":"2024-04-26T00:50:39.866036+0000","last_active":"2024-04-26T00:50:40.854314+0000","last_peered":"2024-04-26T00:50:40.854314+0000","last_clean":"2024-04-26T00:50:40.854314+0000","last_became_active":"2024-04-26T00:50:39.864772+0000","last_became_peered":"2024-04-26T00:50:39.864772+0000","last_unstale":"2024-04-26T00:50:40.854314+0000","last_undegraded":"2024-04-26T00:50:40.854314+0000","last_fullsized":"2024-04-26T00:50:40.854314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:20.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850148+0000","last_change":"2024-04-26T00:50:39.850402+0000","last_active":"2024-04-26T00:50:40.850148+0000","last_peered":"2024-04-26T00:50:40.850148+0000","last_clean":"2024-04-26T00:50:40.850148+0000","last_became_active":"2024-04-26T00:50:39.849824+0000","last_became_peered":"2024-04-26T00:50:39.849824+0000","last_unstale":"2024-04-26T00:50:40.850148+0000","last_undegraded":"2024-04-26T00:50:40.850148+0000","last_fullsized":"2024-04-26T00:50:40.850148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849803+0000","last_change":"2024-04-26T00:50:39.859504+0000","last_active":"2024-04-26T00:50:40.849803+0000","last_peered":"2024-04-26T00:50:40.849803+0000","last_clean":"2024-04-26T00:50:40.849803+0000","last_became_active":"2024-04-26T00:50:39.858895+0000","last_became_peered":"2024-04-26T00:50:39.858895+0000","last_unstale":"2024-04-26T00:50:40.849803+0000","last_undegraded":"2024-04-26T00:50:40.849803+0000","last_fullsized":"2024-04-26T00:50:40.849803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849230+0000","last_change":"2024-04-26T00:50:39.862674+0000","last_active":"2024-04-26T00:50:40.849230+0000","last_peered":"2024-04-26T00:50:40.849230+0000","last_clean":"2024-04-26T00:50:40.849230+0000","last_became_active":"2024-04-26T00:50:39.862064+0000","last_became_peered":"2024-04-26T00:50:39.862064+0000","last_unstale":"2024-04-26T00:50:40.849230+0000","last_undegraded":"2024-04-26T00:50:40.849230+0000","last_fullsized":"2024-04-26T00:50:40.849230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469383+0000","last_change":"2024-04-26T00:50:39.868719+0000","last_active":"2024-04-26T00:50:41.469383+0000","last_peered":"2024-04-26T00:50:41.469383+0000","last_clean":"2024-04-26T00:50:41.469383+0000","last_became_active":"2024-04-26T00:50:39.868234+0000","last_became_peered":"2024-04-26T00:50:39.868234+0000","last_unstale":"2024-04-26T00:50:41.469383+0000","last_undegraded":"2024-04-26T00:50:41.469383+0000","last_fullsized":"2024-04-26T00:50:41.469383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467114+0000","last_change":"2024-04-26T00:50:39.864259+0000","last_active":"2024-04-26T00:50:41.467114+0000","last_peered":"2024-04-26T00:50:41.467114+0000","last_clean":"2024-04-26T00:50:41.467114+0000","last_became_active":"2024-04-26T00:50:39.863983+0000","last_became_peered":"2024-04-26T00:50:39.863983+0000","last_unstale":"2024-04-26T00:50:41.467114+0000","last_undegraded":"2024-04-26T00:50:41.467114+0000","last_fullsized":"2024-04-26T00:50:41.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854744+0000","last_change":"2024-04-26T00:50:39.865590+0000","last_active":"2024-04-26T00:50:40.854744+0000","last_peered":"2024-04-26T00:50:40.854744+0000","last_clean":"2024-04-26T00:50:40.854744+0000","last_became_active":"2024-04-26T00:50:39.865319+0000","last_became_peered":"2024-04-26T00:50:39.865319+0000","last_unstale":"2024-04-26T00:50:40.854744+0000","last_undegraded":"2024-04-26T00:50:40.854744+0000","last_fullsized":"2024-04-26T00:50:40.854744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:20.997241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467605+0000","last_change":"2024-04-26T00:50:39.856108+0000","last_active":"2024-04-26T00:50:41.467605+0000","last_peered":"2024-04-26T00:50:41.467605+0000","last_clean":"2024-04-26T00:50:41.467605+0000","last_became_active":"2024-04-26T00:50:39.855807+0000","last_became_peered":"2024-04-26T00:50:39.855807+0000","last_unstale":"2024-04-26T00:50:41.467605+0000","last_undegraded":"2024-04-26T00:50:41.467605+0000","last_fullsized":"2024-04-26T00:50:41.467605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850863+0000","last_change":"2024-04-26T00:50:39.843134+0000","last_active":"2024-04-26T00:50:40.850863+0000","last_peered":"2024-04-26T00:50:40.850863+0000","last_clean":"2024-04-26T00:50:40.850863+0000","last_became_active":"2024-04-26T00:50:39.842326+0000","last_became_peered":"2024-04-26T00:50:39.842326+0000","last_unstale":"2024-04-26T00:50:40.850863+0000","last_undegraded":"2024-04-26T00:50:40.850863+0000","last_fullsized":"2024-04-26T00:50:40.850863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:10:05.591117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464540+0000","last_change":"2024-04-26T00:50:39.854346+0000","last_active":"2024-04-26T00:50:41.464540+0000","last_peered":"2024-04-26T00:50:41.464540+0000","last_clean":"2024-04-26T00:50:41.464540+0000","last_became_active":"2024-04-26T00:50:39.854039+0000","last_became_peered":"2024-04-26T00:50:39.854039+0000","last_unstale":"2024-04-26T00:50:41.464540+0000","last_undegraded":"2024-04-26T00:50:41.464540+0000","last_fullsized":"2024-04-26T00:50:41.464540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465787+0000","last_change":"2024-04-26T00:50:39.860520+0000","last_active":"2024-04-26T00:50:41.465787+0000","last_peered":"2024-04-26T00:50:41.465787+0000","last_clean":"2024-04-26T00:50:41.465787+0000","last_became_active":"2024-04-26T00:50:39.859357+0000","last_became_peered":"2024-04-26T00:50:39.859357+0000","last_unstale":"2024-04-26T00:50:41.465787+0000","last_undegraded":"2024-04-26T00:50:41.465787+0000","last_fullsized":"2024-04-26T00:50:41.465787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849398+0000","last_change":"2024-04-26T00:50:39.858882+0000","last_active":"2024-04-26T00:50:40.849398+0000","last_peered":"2024-04-26T00:50:40.849398+0000","last_clean":"2024-04-26T00:50:40.849398+0000","last_became_active":"2024-04-26T00:50:39.858565+0000","last_became_peered":"2024-04-26T00:50:39.858565+0000","last_unstale":"2024-04-26T00:50:40.849398+0000","last_undegraded":"2024-04-26T00:50:40.849398+0000","last_fullsized":"2024-04-26T00:50:40.849398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468918+0000","last_change":"2024-04-26T00:50:39.857963+0000","last_active":"2024-04-26T00:50:41.468918+0000","last_peered":"2024-04-26T00:50:41.468918+0000","last_clean":"2024-04-26T00:50:41.468918+0000","last_became_active":"2024-04-26T00:50:39.857599+0000","last_became_peered":"2024-04-26T00:50:39.857599+0000","last_unstale":"2024-04-26T00:50:41.468918+0000","last_undegraded":"2024-04-26T00:50:41.468918+0000","last_fullsized":"2024-04-26T00:50:41.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469225+0000","last_change":"2024-04-26T00:50:39.863645+0000","last_active":"2024-04-26T00:50:41.469225+0000","last_peered":"2024-04-26T00:50:41.469225+0000","last_clean":"2024-04-26T00:50:41.469225+0000","last_became_active":"2024-04-26T00:50:39.863391+0000","last_became_peered":"2024-04-26T00:50:39.863391+0000","last_unstale":"2024-04-26T00:50:41.469225+0000","last_undegraded":"2024-04-26T00:50:41.469225+0000","last_fullsized":"2024-04-26T00:50:41.469225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852851+0000","last_change":"2024-04-26T00:50:39.860126+0000","last_active":"2024-04-26T00:50:40.852851+0000","last_peered":"2024-04-26T00:50:40.852851+0000","last_clean":"2024-04-26T00:50:40.852851+0000","last_became_active":"2024-04-26T00:50:39.859701+0000","last_became_peered":"2024-04-26T00:50:39.859701+0000","last_unstale":"2024-04-26T00:50:40.852851+0000","last_undegraded":"2024-04-26T00:50:40.852851+0000","last_fullsized":"2024-04-26T00:50:40.852851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:26:07.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468277+0000","last_change":"2024-04-26T00:50:39.868579+0000","last_active":"2024-04-26T00:50:41.468277+0000","last_peered":"2024-04-26T00:50:41.468277+0000","last_clean":"2024-04-26T00:50:41.468277+0000","last_became_active":"2024-04-26T00:50:39.868213+0000","last_became_peered":"2024-04-26T00:50:39.868213+0000","last_unstale":"2024-04-26T00:50:41.468277+0000","last_undegraded":"2024-04-26T00:50:41.468277+0000","last_fullsized":"2024-04-26T00:50:41.468277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465290+0000","last_change":"2024-04-26T00:50:39.855232+0000","last_active":"2024-04-26T00:50:41.465290+0000","last_peered":"2024-04-26T00:50:41.465290+0000","last_clean":"2024-04-26T00:50:41.465290+0000","last_became_active":"2024-04-26T00:50:39.852449+0000","last_became_peered":"2024-04-26T00:50:39.852449+0000","last_unstale":"2024-04-26T00:50:41.465290+0000","last_undegraded":"2024-04-26T00:50:41.465290+0000","last_fullsized":"2024-04-26T00:50:41.465290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:10.850384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465536+0000","last_change":"2024-04-26T00:50:39.852258+0000","last_active":"2024-04-26T00:50:41.465536+0000","last_peered":"2024-04-26T00:50:41.465536+0000","last_clean":"2024-04-26T00:50:41.465536+0000","last_became_active":"2024-04-26T00:50:39.851730+0000","last_became_peered":"2024-04-26T00:50:39.851730+0000","last_unstale":"2024-04-26T00:50:41.465536+0000","last_undegraded":"2024-04-26T00:50:41.465536+0000","last_fullsized":"2024-04-26T00:50:41.465536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465455+0000","last_change":"2024-04-26T00:50:39.848331+0000","last_active":"2024-04-26T00:50:41.465455+0000","last_peered":"2024-04-26T00:50:41.465455+0000","last_clean":"2024-04-26T00:50:41.465455+0000","last_became_active":"2024-04-26T00:50:39.848027+0000","last_became_peered":"2024-04-26T00:50:39.848027+0000","last_unstale":"2024-04-26T00:50:41.465455+0000","last_undegraded":"2024-04-26T00:50:41.465455+0000","last_fullsized":"2024-04-26T00:50:41.465455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:10.545861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849646+0000","last_change":"2024-04-26T00:50:39.862385+0000","last_active":"2024-04-26T00:50:40.849646+0000","last_peered":"2024-04-26T00:50:40.849646+0000","last_clean":"2024-04-26T00:50:40.849646+0000","last_became_active":"2024-04-26T00:50:39.861979+0000","last_became_peered":"2024-04-26T00:50:39.861979+0000","last_unstale":"2024-04-26T00:50:40.849646+0000","last_undegraded":"2024-04-26T00:50:40.849646+0000","last_fullsized":"2024-04-26T00:50:40.849646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465788+0000","last_change":"2024-04-26T00:50:39.857971+0000","last_active":"2024-04-26T00:50:41.465788+0000","last_peered":"2024-04-26T00:50:41.465788+0000","last_clean":"2024-04-26T00:50:41.465788+0000","last_became_active":"2024-04-26T00:50:39.857706+0000","last_became_peered":"2024-04-26T00:50:39.857706+0000","last_unstale":"2024-04-26T00:50:41.465788+0000","last_undegraded":"2024-04-26T00:50:41.465788+0000","last_fullsized":"2024-04-26T00:50:41.465788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466603+0000","last_change":"2024-04-26T00:50:38.870203+0000","last_active":"2024-04-26T00:50:41.466603+0000","last_peered":"2024-04-26T00:50:41.466603+0000","last_clean":"2024-04-26T00:50:41.466603+0000","last_became_active":"2024-04-26T00:50:38.869667+0000","last_became_peered":"2024-04-26T00:50:38.869667+0000","last_unstale":"2024-04-26T00:50:41.466603+0000","last_undegraded":"2024-04-26T00:50:41.466603+0000","last_fullsized":"2024-04-26T00:50:41.466603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.946855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466766+0000","last_change":"2024-04-26T00:50:39.851780+0000","last_active":"2024-04-26T00:50:41.466766+0000","last_peered":"2024-04-26T00:50:41.466766+0000","last_clean":"2024-04-26T00:50:41.466766+0000","last_became_active":"2024-04-26T00:50:39.851487+0000","last_became_peered":"2024-04-26T00:50:39.851487+0000","last_unstale":"2024-04-26T00:50:41.466766+0000","last_undegraded":"2024-04-26T00:50:41.466766+0000","last_fullsized":"2024-04-26T00:50:41.466766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854350+0000","last_change":"2024-04-26T00:50:38.858405+0000","last_active":"2024-04-26T00:50:40.854350+0000","last_peered":"2024-04-26T00:50:40.854350+0000","last_clean":"2024-04-26T00:50:40.854350+0000","last_became_active":"2024-04-26T00:50:38.857294+0000","last_became_peered":"2024-04-26T00:50:38.857294+0000","last_unstale":"2024-04-26T00:50:40.854350+0000","last_undegraded":"2024-04-26T00:50:40.854350+0000","last_fullsized":"2024-04-26T00:50:40.854350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.943770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466331+0000","last_change":"2024-04-26T00:50:39.854371+0000","last_active":"2024-04-26T00:50:41.466331+0000","last_peered":"2024-04-26T00:50:41.466331+0000","last_clean":"2024-04-26T00:50:41.466331+0000","last_became_active":"2024-04-26T00:50:39.851258+0000","last_became_peered":"2024-04-26T00:50:39.851258+0000","last_unstale":"2024-04-26T00:50:41.466331+0000","last_undegraded":"2024-04-26T00:50:41.466331+0000","last_fullsized":"2024-04-26T00:50:41.466331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850071+0000","last_change":"2024-04-26T00:50:38.855662+0000","last_active":"2024-04-26T00:50:40.850071+0000","last_peered":"2024-04-26T00:50:40.850071+0000","last_clean":"2024-04-26T00:50:40.850071+0000","last_became_active":"2024-04-26T00:50:38.855264+0000","last_became_peered":"2024-04-26T00:50:38.855264+0000","last_unstale":"2024-04-26T00:50:40.850071+0000","last_undegraded":"2024-04-26T00:50:40.850071+0000","last_fullsized":"2024-04-26T00:50:40.850071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:54.888616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468580+0000","last_change":"2024-04-26T00:50:39.860246+0000","last_active":"2024-04-26T00:50:41.468580+0000","last_peered":"2024-04-26T00:50:41.468580+0000","last_clean":"2024-04-26T00:50:41.468580+0000","last_became_active":"2024-04-26T00:50:39.859961+0000","last_became_peered":"2024-04-26T00:50:39.859961+0000","last_unstale":"2024-04-26T00:50:41.468580+0000","last_undegraded":"2024-04-26T00:50:41.468580+0000","last_fullsized":"2024-04-26T00:50:41.468580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849532+0000","last_change":"2024-04-26T00:50:38.858626+0000","last_active":"2024-04-26T00:50:40.849532+0000","last_peered":"2024-04-26T00:50:40.849532+0000","last_clean":"2024-04-26T00:50:40.849532+0000","last_became_active":"2024-04-26T00:50:38.858137+0000","last_became_peered":"2024-04-26T00:50:38.858137+0000","last_unstale":"2024-04-26T00:50:40.849532+0000","last_undegraded":"2024-04-26T00:50:40.849532+0000","last_fullsized":"2024-04-26T00:50:40.849532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:38.523333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852229+0000","last_change":"2024-04-26T00:50:38.873856+0000","last_active":"2024-04-26T00:50:40.852229+0000","last_peered":"2024-04-26T00:50:40.852229+0000","last_clean":"2024-04-26T00:50:40.852229+0000","last_became_active":"2024-04-26T00:50:38.873335+0000","last_became_peered":"2024-04-26T00:50:38.873335+0000","last_unstale":"2024-04-26T00:50:40.852229+0000","last_undegraded":"2024-04-26T00:50:40.852229+0000","last_fullsized":"2024-04-26T00:50:40.852229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:50.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465911+0000","last_change":"2024-04-26T00:50:39.848253+0000","last_active":"2024-04-26T00:50:41.465911+0000","last_peered":"2024-04-26T00:50:41.465911+0000","last_clean":"2024-04-26T00:50:41.465911+0000","last_became_active":"2024-04-26T00:50:39.847884+0000","last_became_peered":"2024-04-26T00:50:39.847884+0000","last_unstale":"2024-04-26T00:50:41.465911+0000","last_undegraded":"2024-04-26T00:50:41.465911+0000","last_fullsized":"2024-04-26T00:50:41.465911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851684+0000","last_change":"2024-04-26T00:50:38.845913+0000","last_active":"2024-04-26T00:50:40.851684+0000","last_peered":"2024-04-26T00:50:40.851684+0000","last_clean":"2024-04-26T00:50:40.851684+0000","last_became_active":"2024-04-26T00:50:38.845248+0000","last_became_peered":"2024-04-26T00:50:38.845248+0000","last_unstale":"2024-04-26T00:50:40.851684+0000","last_undegraded":"2024-04-26T00:50:40.851684+0000","last_fullsized":"2024-04-26T00:50:40.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:01:14.839151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465102+0000","last_change":"2024-04-26T00:50:39.862106+0000","last_active":"2024-04-26T00:50:41.465102+0000","last_peered":"2024-04-26T00:50:41.465102+0000","last_clean":"2024-04-26T00:50:41.465102+0000","last_became_active":"2024-04-26T00:50:39.861838+0000","last_became_peered":"2024-04-26T00:50:39.861838+0000","last_unstale":"2024-04-26T00:50:41.465102+0000","last_undegraded":"2024-04-26T00:50:41.465102+0000","last_fullsized":"2024-04-26T00:50:41.465102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852430+0000","last_change":"2024-04-26T00:50:38.869341+0000","last_active":"2024-04-26T00:50:40.852430+0000","last_peered":"2024-04-26T00:50:40.852430+0000","last_clean":"2024-04-26T00:50:40.852430+0000","last_became_active":"2024-04-26T00:50:38.868538+0000","last_became_peered":"2024-04-26T00:50:38.868538+0000","last_unstale":"2024-04-26T00:50:40.852430+0000","last_undegraded":"2024-04-26T00:50:40.852430+0000","last_fullsized":"2024-04-26T00:50:40.852430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:09.233129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850440+0000","last_change":"2024-04-26T00:50:39.838874+0000","last_active":"2024-04-26T00:50:40.850440+0000","last_peered":"2024-04-26T00:50:40.850440+0000","last_clean":"2024-04-26T00:50:40.850440+0000","last_became_active":"2024-04-26T00:50:39.838130+0000","last_became_peered":"2024-04-26T00:50:39.838130+0000","last_unstale":"2024-04-26T00:50:40.850440+0000","last_undegraded":"2024-04-26T00:50:40.850440+0000","last_fullsized":"2024-04-26T00:50:40.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851387+0000","last_change":"2024-04-26T00:50:38.852912+0000","last_active":"2024-04-26T00:50:40.851387+0000","last_peered":"2024-04-26T00:50:40.851387+0000","last_clean":"2024-04-26T00:50:40.851387+0000","last_became_active":"2024-04-26T00:50:38.852425+0000","last_became_peered":"2024-04-26T00:50:38.852425+0000","last_unstale":"2024-04-26T00:50:40.851387+0000","last_undegraded":"2024-04-26T00:50:40.851387+0000","last_fullsized":"2024-04-26T00:50:40.851387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:26.487714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854707+0000","last_change":"2024-04-26T00:50:39.858386+0000","last_active":"2024-04-26T00:50:40.854707+0000","last_peered":"2024-04-26T00:50:40.854707+0000","last_clean":"2024-04-26T00:50:40.854707+0000","last_became_active":"2024-04-26T00:50:39.858084+0000","last_became_peered":"2024-04-26T00:50:39.858084+0000","last_unstale":"2024-04-26T00:50:40.854707+0000","last_undegraded":"2024-04-26T00:50:40.854707+0000","last_fullsized":"2024-04-26T00:50:40.854707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:24.695303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466946+0000","last_change":"2024-04-26T00:50:38.876499+0000","last_active":"2024-04-26T00:50:41.466946+0000","last_peered":"2024-04-26T00:50:41.466946+0000","last_clean":"2024-04-26T00:50:41.466946+0000","last_became_active":"2024-04-26T00:50:38.875568+0000","last_became_peered":"2024-04-26T00:50:38.875568+0000","last_unstale":"2024-04-26T00:50:41.466946+0000","last_undegraded":"2024-04-26T00:50:41.466946+0000","last_fullsized":"2024-04-26T00:50:41.466946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:08.851681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467684+0000","last_change":"2024-04-26T00:50:39.861634+0000","last_active":"2024-04-26T00:50:41.467684+0000","last_peered":"2024-04-26T00:50:41.467684+0000","last_clean":"2024-04-26T00:50:41.467684+0000","last_became_active":"2024-04-26T00:50:39.860919+0000","last_became_peered":"2024-04-26T00:50:39.860919+0000","last_unstale":"2024-04-26T00:50:41.467684+0000","last_undegraded":"2024-04-26T00:50:41.467684+0000","last_fullsized":"2024-04-26T00:50:41.467684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:38.858272+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:38.857911+0000","last_became_peered":"2024-04-26T00:50:38.857911+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:02.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851832+0000","last_change":"2024-04-26T00:50:39.855731+0000","last_active":"2024-04-26T00:50:40.851832+0000","last_peered":"2024-04-26T00:50:40.851832+0000","last_clean":"2024-04-26T00:50:40.851832+0000","last_became_active":"2024-04-26T00:50:39.855401+0000","last_became_peered":"2024-04-26T00:50:39.855401+0000","last_unstale":"2024-04-26T00:50:40.851832+0000","last_undegraded":"2024-04-26T00:50:40.851832+0000","last_fullsized":"2024-04-26T00:50:40.851832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:05.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466079+0000","last_change":"2024-04-26T00:50:38.876014+0000","last_active":"2024-04-26T00:50:41.466079+0000","last_peered":"2024-04-26T00:50:41.466079+0000","last_clean":"2024-04-26T00:50:41.466079+0000","last_became_active":"2024-04-26T00:50:38.875346+0000","last_became_peered":"2024-04-26T00:50:38.875346+0000","last_unstale":"2024-04-26T00:50:41.466079+0000","last_undegraded":"2024-04-26T00:50:41.466079+0000","last_fullsized":"2024-04-26T00:50:41.466079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:25.084153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855287+0000","last_change":"2024-04-26T00:50:39.852334+0000","last_active":"2024-04-26T00:50:40.855287+0000","last_peered":"2024-04-26T00:50:40.855287+0000","last_clean":"2024-04-26T00:50:40.855287+0000","last_became_active":"2024-04-26T00:50:39.849126+0000","last_became_peered":"2024-04-26T00:50:39.849126+0000","last_unstale":"2024-04-26T00:50:40.855287+0000","last_undegraded":"2024-04-26T00:50:40.855287+0000","last_fullsized":"2024-04-26T00:50:40.855287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:55.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464952+0000","last_change":"2024-04-26T00:50:38.879815+0000","last_active":"2024-04-26T00:50:41.464952+0000","last_peered":"2024-04-26T00:50:41.464952+0000","last_clean":"2024-04-26T00:50:41.464952+0000","last_became_active":"2024-04-26T00:50:38.876392+0000","last_became_peered":"2024-04-26T00:50:38.876392+0000","last_unstale":"2024-04-26T00:50:41.464952+0000","last_undegraded":"2024-04-26T00:50:41.464952+0000","last_fullsized":"2024-04-26T00:50:41.464952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:07.680535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469056+0000","last_change":"2024-04-26T00:50:39.862953+0000","last_active":"2024-04-26T00:50:41.469056+0000","last_peered":"2024-04-26T00:50:41.469056+0000","last_clean":"2024-04-26T00:50:41.469056+0000","last_became_active":"2024-04-26T00:50:39.862133+0000","last_became_peered":"2024-04-26T00:50:39.862133+0000","last_unstale":"2024-04-26T00:50:41.469056+0000","last_undegraded":"2024-04-26T00:50:41.469056+0000","last_fullsized":"2024-04-26T00:50:41.469056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464665+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:41.464665+0000","last_peered":"2024-04-26T00:50:41.464665+0000","last_clean":"2024-04-26T00:50:41.464665+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:41.464665+0000","last_undegraded":"2024-04-26T00:50:41.464665+0000","last_fullsized":"2024-04-26T00:50:41.464665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851020+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:40.851020+0000","last_peered":"2024-04-26T00:50:40.851020+0000","last_clean":"2024-04-26T00:50:40.851020+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:40.851020+0000","last_undegraded":"2024-04-26T00:50:40.851020+0000","last_fullsized":"2024-04-26T00:50:40.851020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467042+0000","last_change":"2024-04-26T00:50:38.866703+0000","last_active":"2024-04-26T00:50:41.467042+0000","last_peered":"2024-04-26T00:50:41.467042+0000","last_clean":"2024-04-26T00:50:41.467042+0000","last_became_active":"2024-04-26T00:50:38.866123+0000","last_became_peered":"2024-04-26T00:50:38.866123+0000","last_unstale":"2024-04-26T00:50:41.467042+0000","last_undegraded":"2024-04-26T00:50:41.467042+0000","last_fullsized":"2024-04-26T00:50:41.467042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:09.927849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852406+0000","last_change":"2024-04-26T00:50:39.859004+0000","last_active":"2024-04-26T00:50:40.852406+0000","last_peered":"2024-04-26T00:50:40.852406+0000","last_clean":"2024-04-26T00:50:40.852406+0000","last_became_active":"2024-04-26T00:50:39.858536+0000","last_became_peered":"2024-04-26T00:50:39.858536+0000","last_unstale":"2024-04-26T00:50:40.852406+0000","last_undegraded":"2024-04-26T00:50:40.852406+0000","last_fullsized":"2024-04-26T00:50:40.852406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:44.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849761+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:40.849761+0000","last_peered":"2024-04-26T00:50:40.849761+0000","last_clean":"2024-04-26T00:50:40.849761+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:40.849761+0000","last_undegraded":"2024-04-26T00:50:40.849761+0000","last_fullsized":"2024-04-26T00:50:40.849761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465609+0000","last_change":"2024-04-26T00:50:38.862050+0000","last_active":"2024-04-26T00:50:41.465609+0000","last_peered":"2024-04-26T00:50:41.465609+0000","last_clean":"2024-04-26T00:50:41.465609+0000","last_became_active":"2024-04-26T00:50:38.861329+0000","last_became_peered":"2024-04-26T00:50:38.861329+0000","last_unstale":"2024-04-26T00:50:41.465609+0000","last_undegraded":"2024-04-26T00:50:41.465609+0000","last_fullsized":"2024-04-26T00:50:41.465609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:19.670169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466871+0000","last_change":"2024-04-26T00:50:39.859556+0000","last_active":"2024-04-26T00:50:41.466871+0000","last_peered":"2024-04-26T00:50:41.466871+0000","last_clean":"2024-04-26T00:50:41.466871+0000","last_became_active":"2024-04-26T00:50:39.858347+0000","last_became_peered":"2024-04-26T00:50:39.858347+0000","last_unstale":"2024-04-26T00:50:41.466871+0000","last_undegraded":"2024-04-26T00:50:41.466871+0000","last_fullsized":"2024-04-26T00:50:41.466871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854116+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:40.854116+0000","last_peered":"2024-04-26T00:50:40.854116+0000","last_clean":"2024-04-26T00:50:40.854116+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:40.854116+0000","last_undegraded":"2024-04-26T00:50:40.854116+0000","last_fullsized":"2024-04-26T00:50:40.854116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464225+0000","last_change":"2024-04-26T00:50:38.864670+0000","last_active":"2024-04-26T00:50:41.464225+0000","last_peered":"2024-04-26T00:50:41.464225+0000","last_clean":"2024-04-26T00:50:41.464225+0000","last_became_active":"2024-04-26T00:50:38.861543+0000","last_became_peered":"2024-04-26T00:50:38.861543+0000","last_unstale":"2024-04-26T00:50:41.464225+0000","last_undegraded":"2024-04-26T00:50:41.464225+0000","last_fullsized":"2024-04-26T00:50:41.464225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469153+0000","last_change":"2024-04-26T00:50:39.862379+0000","last_active":"2024-04-26T00:50:41.469153+0000","last_peered":"2024-04-26T00:50:41.469153+0000","last_clean":"2024-04-26T00:50:41.469153+0000","last_became_active":"2024-04-26T00:50:39.860598+0000","last_became_peered":"2024-04-26T00:50:39.860598+0000","last_unstale":"2024-04-26T00:50:41.469153+0000","last_undegraded":"2024-04-26T00:50:41.469153+0000","last_fullsized":"2024-04-26T00:50:41.469153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850966+0000","last_change":"2024-04-26T00:50:38.857970+0000","last_active":"2024-04-26T00:50:40.850966+0000","last_peered":"2024-04-26T00:50:40.850966+0000","last_clean":"2024-04-26T00:50:40.850966+0000","last_became_active":"2024-04-26T00:50:38.857664+0000","last_became_peered":"2024-04-26T00:50:38.857664+0000","last_unstale":"2024-04-26T00:50:40.850966+0000","last_undegraded":"2024-04-26T00:50:40.850966+0000","last_fullsized":"2024-04-26T00:50:40.850966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.406470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467834+0000","last_change":"2024-04-26T00:50:39.868652+0000","last_active":"2024-04-26T00:50:41.467834+0000","last_peered":"2024-04-26T00:50:41.467834+0000","last_clean":"2024-04-26T00:50:41.467834+0000","last_became_active":"2024-04-26T00:50:39.868244+0000","last_became_peered":"2024-04-26T00:50:39.868244+0000","last_unstale":"2024-04-26T00:50:41.467834+0000","last_undegraded":"2024-04-26T00:50:41.467834+0000","last_fullsized":"2024-04-26T00:50:41.467834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852702+0000","last_change":"2024-04-26T00:50:38.868988+0000","last_active":"2024-04-26T00:50:40.852702+0000","last_peered":"2024-04-26T00:50:40.852702+0000","last_clean":"2024-04-26T00:50:40.852702+0000","last_became_active":"2024-04-26T00:50:38.868419+0000","last_became_peered":"2024-04-26T00:50:38.868419+0000","last_unstale":"2024-04-26T00:50:40.852702+0000","last_undegraded":"2024-04-26T00:50:40.852702+0000","last_fullsized":"2024-04-26T00:50:40.852702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.246593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468295+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:41.468295+0000","last_peered":"2024-04-26T00:50:41.468295+0000","last_clean":"2024-04-26T00:50:41.468295+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:41.468295+0000","last_undegraded":"2024-04-26T00:50:41.468295+0000","last_fullsized":"2024-04-26T00:50:41.468295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464953+0000","last_change":"2024-04-26T00:50:39.855312+0000","last_active":"2024-04-26T00:50:41.464953+0000","last_peered":"2024-04-26T00:50:41.464953+0000","last_clean":"2024-04-26T00:50:41.464953+0000","last_became_active":"2024-04-26T00:50:39.853775+0000","last_became_peered":"2024-04-26T00:50:39.853775+0000","last_unstale":"2024-04-26T00:50:41.464953+0000","last_undegraded":"2024-04-26T00:50:41.464953+0000","last_fullsized":"2024-04-26T00:50:41.464953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468158+0000","last_change":"2024-04-26T00:50:38.863255+0000","last_active":"2024-04-26T00:50:41.468158+0000","last_peered":"2024-04-26T00:50:41.468158+0000","last_clean":"2024-04-26T00:50:41.468158+0000","last_became_active":"2024-04-26T00:50:38.861925+0000","last_became_peered":"2024-04-26T00:50:38.861925+0000","last_unstale":"2024-04-26T00:50:41.468158+0000","last_undegraded":"2024-04-26T00:50:41.468158+0000","last_fullsized":"2024-04-26T00:50:41.468158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:37.293965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852840+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:40.852840+0000","last_peered":"2024-04-26T00:50:40.852840+0000","last_clean":"2024-04-26T00:50:40.852840+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:40.852840+0000","last_undegraded":"2024-04-26T00:50:40.852840+0000","last_fullsized":"2024-04-26T00:50:40.852840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467285+0000","last_change":"2024-04-26T00:50:39.859688+0000","last_active":"2024-04-26T00:50:41.467285+0000","last_peered":"2024-04-26T00:50:41.467285+0000","last_clean":"2024-04-26T00:50:41.467285+0000","last_became_active":"2024-04-26T00:50:39.859353+0000","last_became_peered":"2024-04-26T00:50:39.859353+0000","last_unstale":"2024-04-26T00:50:41.467285+0000","last_undegraded":"2024-04-26T00:50:41.467285+0000","last_fullsized":"2024-04-26T00:50:41.467285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468552+0000","last_change":"2024-04-26T00:50:38.876486+0000","last_active":"2024-04-26T00:50:41.468552+0000","last_peered":"2024-04-26T00:50:41.468552+0000","last_clean":"2024-04-26T00:50:41.468552+0000","last_became_active":"2024-04-26T00:50:38.875909+0000","last_became_peered":"2024-04-26T00:50:38.875909+0000","last_unstale":"2024-04-26T00:50:41.468552+0000","last_undegraded":"2024-04-26T00:50:41.468552+0000","last_fullsized":"2024-04-26T00:50:41.468552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:40:21.077132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469439+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:41.469439+0000","last_peered":"2024-04-26T00:50:41.469439+0000","last_clean":"2024-04-26T00:50:41.469439+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:41.469439+0000","last_undegraded":"2024-04-26T00:50:41.469439+0000","last_fullsized":"2024-04-26T00:50:41.469439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464450+0000","last_change":"2024-04-26T00:50:39.848704+0000","last_active":"2024-04-26T00:50:41.464450+0000","last_peered":"2024-04-26T00:50:41.464450+0000","last_clean":"2024-04-26T00:50:41.464450+0000","last_became_active":"2024-04-26T00:50:39.848429+0000","last_became_peered":"2024-04-26T00:50:39.848429+0000","last_unstale":"2024-04-26T00:50:41.464450+0000","last_undegraded":"2024-04-26T00:50:41.464450+0000","last_fullsized":"2024-04-26T00:50:41.464450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:40.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.837302+0000","last_change":"2024-04-26T00:50:38.867565+0000","last_active":"2024-04-26T00:50:41.837302+0000","last_peered":"2024-04-26T00:50:41.837302+0000","last_clean":"2024-04-26T00:50:41.837302+0000","last_became_active":"2024-04-26T00:50:38.866728+0000","last_became_peered":"2024-04-26T00:50:38.866728+0000","last_unstale":"2024-04-26T00:50:41.837302+0000","last_undegraded":"2024-04-26T00:50:41.837302+0000","last_fullsized":"2024-04-26T00:50:41.837302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:23.691727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852376+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:40.852376+0000","last_peered":"2024-04-26T00:50:40.852376+0000","last_clean":"2024-04-26T00:50:40.852376+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:40.852376+0000","last_undegraded":"2024-04-26T00:50:40.852376+0000","last_fullsized":"2024-04-26T00:50:40.852376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854095+0000","last_change":"2024-04-26T00:50:39.856903+0000","last_active":"2024-04-26T00:50:40.854095+0000","last_peered":"2024-04-26T00:50:40.854095+0000","last_clean":"2024-04-26T00:50:40.854095+0000","last_became_active":"2024-04-26T00:50:39.856609+0000","last_became_peered":"2024-04-26T00:50:39.856609+0000","last_unstale":"2024-04-26T00:50:40.854095+0000","last_undegraded":"2024-04-26T00:50:40.854095+0000","last_fullsized":"2024-04-26T00:50:40.854095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:12.129353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854504+0000","last_change":"2024-04-26T00:50:39.857946+0000","last_active":"2024-04-26T00:50:40.854504+0000","last_peered":"2024-04-26T00:50:40.854504+0000","last_clean":"2024-04-26T00:50:40.854504+0000","last_became_active":"2024-04-26T00:50:39.857653+0000","last_became_peered":"2024-04-26T00:50:39.857653+0000","last_unstale":"2024-04-26T00:50:40.854504+0000","last_undegraded":"2024-04-26T00:50:40.854504+0000","last_fullsized":"2024-04-26T00:50:40.854504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:40.181948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851322+0000","last_change":"2024-04-26T00:50:38.846157+0000","last_active":"2024-04-26T00:50:40.851322+0000","last_peered":"2024-04-26T00:50:40.851322+0000","last_clean":"2024-04-26T00:50:40.851322+0000","last_became_active":"2024-04-26T00:50:38.845728+0000","last_became_peered":"2024-04-26T00:50:38.845728+0000","last_unstale":"2024-04-26T00:50:40.851322+0000","last_undegraded":"2024-04-26T00:50:40.851322+0000","last_fullsized":"2024-04-26T00:50:40.851322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465860+0000","last_change":"2024-04-26T00:50:39.851993+0000","last_active":"2024-04-26T00:50:41.465860+0000","last_peered":"2024-04-26T00:50:41.465860+0000","last_clean":"2024-04-26T00:50:41.465860+0000","last_became_active":"2024-04-26T00:50:39.851385+0000","last_became_peered":"2024-04-26T00:50:39.851385+0000","last_unstale":"2024-04-26T00:50:41.465860+0000","last_undegraded":"2024-04-26T00:50:41.465860+0000","last_fullsized":"2024-04-26T00:50:41.465860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855046+0000","last_change":"2024-04-26T00:50:38.859885+0000","last_active":"2024-04-26T00:50:40.855046+0000","last_peered":"2024-04-26T00:50:40.855046+0000","last_clean":"2024-04-26T00:50:40.855046+0000","last_became_active":"2024-04-26T00:50:38.858568+0000","last_became_peered":"2024-04-26T00:50:38.858568+0000","last_unstale":"2024-04-26T00:50:40.855046+0000","last_undegraded":"2024-04-26T00:50:40.855046+0000","last_fullsized":"2024-04-26T00:50:40.855046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851422+0000","last_change":"2024-04-26T00:50:38.866142+0000","last_active":"2024-04-26T00:50:40.851422+0000","last_peered":"2024-04-26T00:50:40.851422+0000","last_clean":"2024-04-26T00:50:40.851422+0000","last_became_active":"2024-04-26T00:50:38.865557+0000","last_became_peered":"2024-04-26T00:50:38.865557+0000","last_unstale":"2024-04-26T00:50:40.851422+0000","last_undegraded":"2024-04-26T00:50:40.851422+0000","last_fullsized":"2024-04-26T00:50:40.851422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:31.035091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466248+0000","last_change":"2024-04-26T00:50:39.854303+0000","last_active":"2024-04-26T00:50:41.466248+0000","last_peered":"2024-04-26T00:50:41.466248+0000","last_clean":"2024-04-26T00:50:41.466248+0000","last_became_active":"2024-04-26T00:50:39.852216+0000","last_became_peered":"2024-04-26T00:50:39.852216+0000","last_unstale":"2024-04-26T00:50:41.466248+0000","last_undegraded":"2024-04-26T00:50:41.466248+0000","last_fullsized":"2024-04-26T00:50:41.466248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469542+0000","last_change":"2024-04-26T00:50:38.867859+0000","last_active":"2024-04-26T00:50:41.469542+0000","last_peered":"2024-04-26T00:50:41.469542+0000","last_clean":"2024-04-26T00:50:41.469542+0000","last_became_active":"2024-04-26T00:50:38.866771+0000","last_became_peered":"2024-04-26T00:50:38.866771+0000","last_unstale":"2024-04-26T00:50:41.469542+0000","last_undegraded":"2024-04-26T00:50:41.469542+0000","last_fullsized":"2024-04-26T00:50:41.469542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464008+0000","last_change":"2024-04-26T00:50:39.851991+0000","last_active":"2024-04-26T00:50:41.464008+0000","last_peered":"2024-04-26T00:50:41.464008+0000","last_clean":"2024-04-26T00:50:41.464008+0000","last_became_active":"2024-04-26T00:50:39.851680+0000","last_became_peered":"2024-04-26T00:50:39.851680+0000","last_unstale":"2024-04-26T00:50:41.464008+0000","last_undegraded":"2024-04-26T00:50:41.464008+0000","last_fullsized":"2024-04-26T00:50:41.464008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:51.385973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852269+0000","last_change":"2024-04-26T00:50:39.859275+0000","last_active":"2024-04-26T00:50:40.852269+0000","last_peered":"2024-04-26T00:50:40.852269+0000","last_clean":"2024-04-26T00:50:40.852269+0000","last_became_active":"2024-04-26T00:50:39.858722+0000","last_became_peered":"2024-04-26T00:50:39.858722+0000","last_unstale":"2024-04-26T00:50:40.852269+0000","last_undegraded":"2024-04-26T00:50:40.852269+0000","last_fullsized":"2024-04-26T00:50:40.852269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:43.277704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464709+0000","last_change":"2024-04-26T00:50:38.876692+0000","last_active":"2024-04-26T00:50:41.464709+0000","last_peered":"2024-04-26T00:50:41.464709+0000","last_clean":"2024-04-26T00:50:41.464709+0000","last_became_active":"2024-04-26T00:50:38.875789+0000","last_became_peered":"2024-04-26T00:50:38.875789+0000","last_unstale":"2024-04-26T00:50:41.464709+0000","last_undegraded":"2024-04-26T00:50:41.464709+0000","last_fullsized":"2024-04-26T00:50:41.464709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468966+0000","last_change":"2024-04-26T00:50:39.853149+0000","last_active":"2024-04-26T00:50:41.468966+0000","last_peered":"2024-04-26T00:50:41.468966+0000","last_clean":"2024-04-26T00:50:41.468966+0000","last_became_active":"2024-04-26T00:50:39.852980+0000","last_became_peered":"2024-04-26T00:50:39.852980+0000","last_unstale":"2024-04-26T00:50:41.468966+0000","last_undegraded":"2024-04-26T00:50:41.468966+0000","last_fullsized":"2024-04-26T00:50:41.468966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465368+0000","last_change":"2024-04-26T00:50:38.868567+0000","last_active":"2024-04-26T00:50:41.465368+0000","last_peered":"2024-04-26T00:50:41.465368+0000","last_clean":"2024-04-26T00:50:41.465368+0000","last_became_active":"2024-04-26T00:50:38.867948+0000","last_became_peered":"2024-04-26T00:50:38.867948+0000","last_unstale":"2024-04-26T00:50:41.465368+0000","last_undegraded":"2024-04-26T00:50:41.465368+0000","last_fullsized":"2024-04-26T00:50:41.465368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:11.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466691+0000","last_change":"2024-04-26T00:50:39.860208+0000","last_active":"2024-04-26T00:50:41.466691+0000","last_peered":"2024-04-26T00:50:41.466691+0000","last_clean":"2024-04-26T00:50:41.466691+0000","last_became_active":"2024-04-26T00:50:39.859876+0000","last_became_peered":"2024-04-26T00:50:39.859876+0000","last_unstale":"2024-04-26T00:50:41.466691+0000","last_undegraded":"2024-04-26T00:50:41.466691+0000","last_fullsized":"2024-04-26T00:50:41.466691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850749+0000","last_change":"2024-04-26T00:50:38.866484+0000","last_active":"2024-04-26T00:50:40.850749+0000","last_peered":"2024-04-26T00:50:40.850749+0000","last_clean":"2024-04-26T00:50:40.850749+0000","last_became_active":"2024-04-26T00:50:38.865840+0000","last_became_peered":"2024-04-26T00:50:38.865840+0000","last_unstale":"2024-04-26T00:50:40.850749+0000","last_undegraded":"2024-04-26T00:50:40.850749+0000","last_fullsized":"2024-04-26T00:50:40.850749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:37.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855141+0000","last_change":"2024-04-26T00:50:39.866945+0000","last_active":"2024-04-26T00:50:40.855141+0000","last_peered":"2024-04-26T00:50:40.855141+0000","last_clean":"2024-04-26T00:50:40.855141+0000","last_became_active":"2024-04-26T00:50:39.866257+0000","last_became_peered":"2024-04-26T00:50:39.866257+0000","last_unstale":"2024-04-26T00:50:40.855141+0000","last_undegraded":"2024-04-26T00:50:40.855141+0000","last_fullsized":"2024-04-26T00:50:40.855141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:07.845148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466077+0000","last_change":"2024-04-26T00:50:38.870006+0000","last_active":"2024-04-26T00:50:41.466077+0000","last_peered":"2024-04-26T00:50:41.466077+0000","last_clean":"2024-04-26T00:50:41.466077+0000","last_became_active":"2024-04-26T00:50:38.869408+0000","last_became_peered":"2024-04-26T00:50:38.869408+0000","last_unstale":"2024-04-26T00:50:41.466077+0000","last_undegraded":"2024-04-26T00:50:41.466077+0000","last_fullsized":"2024-04-26T00:50:41.466077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:20.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854580+0000","last_change":"2024-04-26T00:50:39.867012+0000","last_active":"2024-04-26T00:50:40.854580+0000","last_peered":"2024-04-26T00:50:40.854580+0000","last_clean":"2024-04-26T00:50:40.854580+0000","last_became_active":"2024-04-26T00:50:39.866002+0000","last_became_peered":"2024-04-26T00:50:39.866002+0000","last_unstale":"2024-04-26T00:50:40.854580+0000","last_undegraded":"2024-04-26T00:50:40.854580+0000","last_fullsized":"2024-04-26T00:50:40.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:38.297542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467910+0000","last_change":"2024-04-26T00:50:38.868711+0000","last_active":"2024-04-26T00:50:41.467910+0000","last_peered":"2024-04-26T00:50:41.467910+0000","last_clean":"2024-04-26T00:50:41.467910+0000","last_became_active":"2024-04-26T00:50:38.868002+0000","last_became_peered":"2024-04-26T00:50:38.868002+0000","last_unstale":"2024-04-26T00:50:41.467910+0000","last_undegraded":"2024-04-26T00:50:41.467910+0000","last_fullsized":"2024-04-26T00:50:41.467910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:39.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850433+0000","last_change":"2024-04-26T00:50:39.857039+0000","last_active":"2024-04-26T00:50:40.850433+0000","last_peered":"2024-04-26T00:50:40.850433+0000","last_clean":"2024-04-26T00:50:40.850433+0000","last_became_active":"2024-04-26T00:50:39.856666+0000","last_became_peered":"2024-04-26T00:50:39.856666+0000","last_unstale":"2024-04-26T00:50:40.850433+0000","last_undegraded":"2024-04-26T00:50:40.850433+0000","last_fullsized":"2024-04-26T00:50:40.850433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852110+0000","last_change":"2024-04-26T00:50:38.849900+0000","last_active":"2024-04-26T00:50:40.852110+0000","last_peered":"2024-04-26T00:50:40.852110+0000","last_clean":"2024-04-26T00:50:40.852110+0000","last_became_active":"2024-04-26T00:50:38.849354+0000","last_became_peered":"2024-04-26T00:50:38.849354+0000","last_unstale":"2024-04-26T00:50:40.852110+0000","last_undegraded":"2024-04-26T00:50:40.852110+0000","last_fullsized":"2024-04-26T00:50:40.852110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:38.438162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467384+0000","last_change":"2024-04-26T00:50:39.863655+0000","last_active":"2024-04-26T00:50:41.467384+0000","last_peered":"2024-04-26T00:50:41.467384+0000","last_clean":"2024-04-26T00:50:41.467384+0000","last_became_active":"2024-04-26T00:50:39.863378+0000","last_became_peered":"2024-04-26T00:50:39.863378+0000","last_unstale":"2024-04-26T00:50:41.467384+0000","last_undegraded":"2024-04-26T00:50:41.467384+0000","last_fullsized":"2024-04-26T00:50:41.467384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467256+0000","last_change":"2024-04-26T00:50:38.876385+0000","last_active":"2024-04-26T00:50:41.467256+0000","last_peered":"2024-04-26T00:50:41.467256+0000","last_clean":"2024-04-26T00:50:41.467256+0000","last_became_active":"2024-04-26T00:50:38.875458+0000","last_became_peered":"2024-04-26T00:50:38.875458+0000","last_unstale":"2024-04-26T00:50:41.467256+0000","last_undegraded":"2024-04-26T00:50:41.467256+0000","last_fullsized":"2024-04-26T00:50:41.467256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849703+0000","last_change":"2024-04-26T00:50:39.847368+0000","last_active":"2024-04-26T00:50:40.849703+0000","last_peered":"2024-04-26T00:50:40.849703+0000","last_clean":"2024-04-26T00:50:40.849703+0000","last_became_active":"2024-04-26T00:50:39.845961+0000","last_became_peered":"2024-04-26T00:50:39.845961+0000","last_unstale":"2024-04-26T00:50:40.849703+0000","last_undegraded":"2024-04-26T00:50:40.849703+0000","last_fullsized":"2024-04-26T00:50:40.849703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469540+0000","last_change":"2024-04-26T00:50:38.873696+0000","last_active":"2024-04-26T00:50:41.469540+0000","last_peered":"2024-04-26T00:50:41.469540+0000","last_clean":"2024-04-26T00:50:41.469540+0000","last_became_active":"2024-04-26T00:50:38.873136+0000","last_became_peered":"2024-04-26T00:50:38.873136+0000","last_unstale":"2024-04-26T00:50:41.469540+0000","last_undegraded":"2024-04-26T00:50:41.469540+0000","last_fullsized":"2024-04-26T00:50:41.469540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:19.993664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":656236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":654556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:48.734 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T00:50:48.734 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T00:50:48.734 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T00:50:48.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T00:50:48.735 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T00:50:48.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 Processor -- start 2024-04-26T00:50:48.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 -- start start 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac0c135ed0 0x7fac0c06ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fac0c14b720 0x7fac0c14db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0c0723e0 con 0x7fac0c139500 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fac0c072a80 con 0x7fac0c135ed0 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1478e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fac0c0725f0 con 0x7fac0c14b720 2024-04-26T00:50:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac0c135ed0 0x7fac0c06ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac0c135ed0 0x7fac0c06ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37342/0 (socket says 172.21.15.6:37342) 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 -- 172.21.15.6:0/833231835 learned_addr learned my addr 172.21.15.6:0/833231835 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac12d2b640 1 --2- 172.21.15.6:0/833231835 >> v2:172.21.15.188:3300/0 conn(0x7fac0c14b720 0x7fac0c14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 -- 172.21.15.6:0/833231835 >> v2:172.21.15.188:3300/0 conn(0x7fac0c14b720 msgr2=0x7fac0c14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 --2- 172.21.15.6:0/833231835 >> v2:172.21.15.188:3300/0 conn(0x7fac0c14b720 0x7fac0c14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 -- 172.21.15.6:0/833231835 >> v1:172.21.15.188:6789/0 conn(0x7fac0c139500 legacy=0x7fac0c0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.892+0000 7fac1252a640 1 -- 172.21.15.6:0/833231835 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c135630 con 0x7fac0c135ed0 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1252a640 1 --2- 172.21.15.6:0/833231835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c135ed0 0x7fac0c06ba30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac0c143fe0 tx=0x7fabfc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93c4d2106e98d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac11528640 1 -- 172.21.15.6:0/833231835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0b2070 con 0x7fac0c135ed0 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac11528640 1 -- 172.21.15.6:0/833231835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc0a9070 con 0x7fac0c135ed0 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac11528640 1 -- 172.21.15.6:0/833231835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0ad880 con 0x7fac0c135ed0 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- 172.21.15.6:0/833231835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c135ed0 msgr2=0x7fac0c06ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- 172.21.15.6:0/833231835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c135ed0 0x7fac0c06ba30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac0c143fe0 tx=0x7fabfc01c470 comp rx=0 tx=0).stop 2024-04-26T00:50:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- 172.21.15.6:0/833231835 shutdown_connections 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- 172.21.15.6:0/833231835 >> v2:172.21.15.188:3300/0 conn(0x7fac0c14b720 0x7fac0c14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- 172.21.15.6:0/833231835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c135ed0 0x7fac0c06ba30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- 172.21.15.6:0/833231835 >> 172.21.15.6:0/833231835 conn(0x7fac0c06cb40 msgr2=0x7fac0c06cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- 172.21.15.6:0/833231835 shutdown_connections 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- 172.21.15.6:0/833231835 wait complete. 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 Processor -- start 2024-04-26T00:50:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- start start 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 0x7fac0c0a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 0x7fac0c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0abd20 con 0x7fac0c14b720 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0abba0 con 0x7fac0c139500 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1478e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c1362b0 con 0x7fac0c135ed0 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac12d2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1252a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 0x7fac0c0a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac12d2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37350/0 (socket says 172.21.15.6:37350) 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac1252a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 0x7fac0c0a30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60636/0 (socket says 172.21.15.6:60636) 2024-04-26T00:50:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac12d2b640 1 -- 172.21.15.6:0/1136341066 learned_addr learned my addr 172.21.15.6:0/1136341066 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.896+0000 7fac11d29640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 0x7fac0c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 -- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 msgr2=0x7fac0c0a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 0x7fac0c0a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 -- 172.21.15.6:0/1136341066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 msgr2=0x7fac0c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 0x7fac0c0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 -- 172.21.15.6:0/1136341066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c0b7570 con 0x7fac0c14b720 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac11d29640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 0x7fac0c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac12d2b640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fac04007cf0 tx=0x7fac0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04014420 con 0x7fac0c14b720 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac04019070 con 0x7fac0c14b720 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c071430 con 0x7fac0c14b720 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04014820 con 0x7fac0c14b720 2024-04-26T00:50:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c0b8230 con 0x7fac0c14b720 2024-04-26T00:50:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c06db70 con 0x7fac0c14b720 2024-04-26T00:50:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fac040149c0 con 0x7fac0c14b720 2024-04-26T00:50:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 0x7fabf009b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac1252a640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 0x7fabf009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fac040c3910 con 0x7fac0c14b720 2024-04-26T00:50:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.900+0000 7fac1252a640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 0x7fabf009b800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0af000 tx=0x7fabfc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:48.904+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fac040948a0 con 0x7fac0c14b720 2024-04-26T00:50:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.108+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fac0c0b6120 con 0x7fac0c14b720 2024-04-26T00:50:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.116+0000 7fac02ffd640 1 -- 172.21.15.6:0/1136341066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+249594 (secure 0 0 0) 0x7fac040941a0 con 0x7fac0c14b720 2024-04-26T00:50:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 10 mgrc shutdown 2024-04-26T00:50:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 msgr2=0x7fabf009b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 0x7fabf009b800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0af000 tx=0x7fabfc008040 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 msgr2=0x7fac0c0b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fac04007cf0 tx=0x7fac0400e4b0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 shutdown_connections 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fabf0099340 0x7fabf009b800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac0c14b720 0x7fac0c0b4c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0c139500 0x7fac0c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 --2- 172.21.15.6:0/1136341066 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fac0c135ed0 0x7fac0c0a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 >> 172.21.15.6:0/1136341066 conn(0x7fac0c06cb40 msgr2=0x7fac0c0a7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 shutdown_connections 2024-04-26T00:50:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.120+0000 7fac1478e640 1 -- 172.21.15.6:0/1136341066 wait complete. 2024-04-26T00:50:49.145 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3851499451},{"type":"v1","addr":"172.21.15.6:6809","nonce":3851499451}]},"active_addr":"172.21.15.6:6809/3851499451","active_change":"2024-04-26T00:50:22.229352+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3711071451}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3479549642}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1596955840}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1514612866}]}]} 2024-04-26T00:50:49.149 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T00:50:49.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T00:50:49.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 Processor -- start 2024-04-26T00:50:49.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 -- start start 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f27e80729c0 0x7f27e80a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e806f0e0 con 0x7f27e8137ca0 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e806f6e0 con 0x7f27e80a7b30 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ef792640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f27e806f9a0 con 0x7f27e80729c0 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f27e8137ca0 0x7f27e8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56968/0 (socket says 172.21.15.6:56968) 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 -- 172.21.15.6:0/3714116827 learned_addr learned my addr 172.21.15.6:0/3714116827 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27edd2f640 1 --2- 172.21.15.6:0/3714116827 >> v2:172.21.15.188:3300/0 conn(0x7f27e80729c0 0x7f27e80a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361215834 0 0) 0x7f27e806f0e0 con 0x7f27e8137ca0 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d4003530 con 0x7f27e8137ca0 2024-04-26T00:50:49.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2051521760 0 0) 0x7f27d4003530 con 0x7f27e8137ca0 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 >> v2:172.21.15.188:3300/0 conn(0x7f27e80729c0 msgr2=0x7f27e80a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 --2- 172.21.15.6:0/3714116827 >> v2:172.21.15.188:3300/0 conn(0x7f27e80729c0 0x7f27e80a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 >> v1:172.21.15.188:6789/0 conn(0x7f27e80a7b30 legacy=0x7f27e8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e806fc60 con 0x7f27e8137ca0 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f27d8001680 con 0x7f27e8137ca0 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 >> v1:172.21.15.6:6789/0 conn(0x7f27e8137ca0 legacy=0x7f27e8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27d40039c0 0x7f27d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 0x7f27d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40052f0 0x7f27d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f27e806f9a0 con 0x7f27d40052f0 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f27d400c1c0 con 0x7f27d40039c0 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f27d400c3c0 con 0x7f27d4004810 2024-04-26T00:50:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 0x7f27d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27edd2f640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40052f0 0x7f27d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ed52e640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27d40039c0 0x7f27d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 -- 172.21.15.6:0/3714116827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27d40039c0 msgr2=0x7f27d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27d40039c0 0x7f27d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 -- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40052f0 msgr2=0x7f27d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40052f0 0x7f27d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27ecd2d640 1 -- 172.21.15.6:0/3714116827 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d4003530 con 0x7f27d4004810 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27edd2f640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40052f0 0x7f27d400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.304+0000 7f27edd2f640 1 -- 172.21.15.6:0/3714116827 reap_dead start 2024-04-26T00:50:49.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 0x7f27d4004c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27e81380a0 tx=0x7f27d801ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b5fe087f9d9207 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8007d20 con 0x7f27d4004810 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80ab070 con 0x7f27d4004810 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27dffff640 1 -- 172.21.15.6:0/3714116827 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d80058e0 con 0x7f27d4004810 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 msgr2=0x7f27d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 0x7f27d4004c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27e81380a0 tx=0x7f27d801ed90 comp rx=0 tx=0).stop 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- 172.21.15.6:0/3714116827 shutdown_connections 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 --2- 172.21.15.6:0/3714116827 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27d4004810 0x7f27d4004c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- 172.21.15.6:0/3714116827 >> 172.21.15.6:0/3714116827 conn(0x7f27e806e230 msgr2=0x7f27e80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- 172.21.15.6:0/3714116827 shutdown_connections 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- 172.21.15.6:0/3714116827 wait complete. 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 Processor -- start 2024-04-26T00:50:49.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- start start 2024-04-26T00:50:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27e81e13e0 0x7f27e81dd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 0x7f27e81dd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f27e8070a90 con 0x7f27d4004810 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f27e8070910 con 0x7f27e81e1820 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ef792640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f27e8070c10 con 0x7f27e81e13e0 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ed52e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ecd2d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27e81e13e0 0x7f27e81dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ed52e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37378/0 (socket says 172.21.15.6:37378) 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.308+0000 7f27ed52e640 1 -- 172.21.15.6:0/3105459418 learned_addr learned my addr 172.21.15.6:0/3105459418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27edd2f640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 0x7f27e81dd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 -- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27e81e13e0 msgr2=0x7f27e81dd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27e81e13e0 0x7f27e81dd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 -- 172.21.15.6:0/3105459418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 msgr2=0x7f27e81dd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 0x7f27e81dd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 -- 172.21.15.6:0/3105459418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e809f950 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27edd2f640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 0x7f27e81dd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ed52e640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e400f650 tx=0x7f27e400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40050d0 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e4018070 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e81e1db0 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4005490 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e80a20f0 con 0x7f27d4004810 2024-04-26T00:50:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e806db70 con 0x7f27d4004810 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f27e400d730 con 0x7f27d4004810 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.312+0000 7f27ddffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 0x7f27cc09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 0x7f27cc09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f27e40c2c00 con 0x7f27d4004810 2024-04-26T00:50:49.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ecd2d640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 0x7f27cc09b9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27d80ad000 tx=0x7f27d80a9070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.316+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f27e4093b90 con 0x7f27d4004810 2024-04-26T00:50:49.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.480+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27e806f340 con 0x7f27d4004810 2024-04-26T00:50:49.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.480+0000 7f27ddffb640 1 -- 172.21.15.6:0/3105459418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7f27e4093490 con 0x7f27d4004810 2024-04-26T00:50:49.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:49.491 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:49.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 10 mgrc shutdown 2024-04-26T00:50:49.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 msgr2=0x7f27cc09b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 0x7f27cc09b9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27d80ad000 tx=0x7f27d80a9070 comp rx=0 tx=0).stop 2024-04-26T00:50:49.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 msgr2=0x7f27e80a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e400f650 tx=0x7f27e400fb10 comp rx=0 tx=0).stop 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 shutdown_connections 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f27cc0994e0 0x7f27cc09b9a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27e81e1820 0x7f27e81dd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f27e81e13e0 0x7f27e81dd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 --2- 172.21.15.6:0/3105459418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4004810 0x7f27e80a17f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 >> 172.21.15.6:0/3105459418 conn(0x7f27e806e230 msgr2=0x7f27e81432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 shutdown_connections 2024-04-26T00:50:49.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.484+0000 7f27ef792640 1 -- 172.21.15.6:0/3105459418 wait complete. 2024-04-26T00:50:49.510 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T00:50:49.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:49.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 Processor -- start 2024-04-26T00:50:49.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 -- start start 2024-04-26T00:50:49.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 0x7f760c14d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760c1396b0 con 0x7f760c0b2d80 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f760c06bce0 con 0x7f760c0b31a0 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f7611d95640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f760c06bfa0 con 0x7f760c06c650 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60666/0 (socket says 172.21.15.6:60666) 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 -- 172.21.15.6:0/1324309156 learned_addr learned my addr 172.21.15.6:0/1324309156 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760bfff640 1 --2- 172.21.15.6:0/1324309156 >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 0x7f760c14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 -- 172.21.15.6:0/1324309156 >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 msgr2=0x7f760c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 --2- 172.21.15.6:0/1324309156 >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 0x7f760c14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 -- 172.21.15.6:0/1324309156 >> v1:172.21.15.188:6789/0 conn(0x7f760c0b2d80 legacy=0x7f760c138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 -- 172.21.15.6:0/1324309156 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c0b1c50 con 0x7f760c06c650 2024-04-26T00:50:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760bfff640 1 --2- 172.21.15.6:0/1324309156 >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 0x7f760c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.620+0000 7f760b7fe640 1 --2- 172.21.15.6:0/1324309156 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009870 tx=0x7f75fc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbdebf434a4b049 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760affd640 1 -- 172.21.15.6:0/1324309156 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0b0070 con 0x7f760c06c650 2024-04-26T00:50:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760affd640 1 -- 172.21.15.6:0/1324309156 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc0ab600 con 0x7f760c06c650 2024-04-26T00:50:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760affd640 1 -- 172.21.15.6:0/1324309156 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0ab9d0 con 0x7f760c06c650 2024-04-26T00:50:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/1324309156 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 msgr2=0x7f760c0a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- 172.21.15.6:0/1324309156 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009870 tx=0x7f75fc01c3e0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/1324309156 shutdown_connections 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- 172.21.15.6:0/1324309156 >> v2:172.21.15.6:3300/0 conn(0x7f760c0b31a0 0x7f760c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- 172.21.15.6:0/1324309156 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c0a6b20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/1324309156 >> 172.21.15.6:0/1324309156 conn(0x7f760c0b71a0 msgr2=0x7f760c0b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/1324309156 shutdown_connections 2024-04-26T00:50:49.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/1324309156 wait complete. 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 Processor -- start 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- start start 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 0x7f760c0abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f760c0aacf0 0x7f760c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f760c1507f0 con 0x7f760c0b2d80 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f760c150670 con 0x7f760c0aacf0 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f760c150970 con 0x7f760c06c650 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7603fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 0x7f760c0abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60676/0 (socket says 172.21.15.6:60676) 2024-04-26T00:50:49.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 -- 172.21.15.6:0/4233937081 learned_addr learned my addr 172.21.15.6:0/4233937081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 -- 172.21.15.6:0/4233937081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f760c0aacf0 msgr2=0x7f760c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f760c0aacf0 0x7f760c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 -- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 msgr2=0x7f760c0abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 0x7f760c0abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 -- 172.21.15.6:0/4233937081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c0afc00 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7603fff640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 0x7f760c0abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f760b7fe640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0ae040 tx=0x7f75fc019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0b0040 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc0ab400 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760c0afea0 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0b4630 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.624+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f760c0af330 con 0x7f760c06c650 2024-04-26T00:50:49.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760c0b0ac0 con 0x7f760c06c650 2024-04-26T00:50:49.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f75fc0bb030 con 0x7f760c06c650 2024-04-26T00:50:49.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 0x7f75ec09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7603fff640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 0x7f75ec09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f75fc15bdf0 con 0x7f760c06c650 2024-04-26T00:50:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.628+0000 7f7603fff640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 0x7f75ec09b800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f760c0b19c0 tx=0x7f75f4007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.632+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f75fc0c2060 con 0x7f760c06c650 2024-04-26T00:50:49.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.792+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f760c06db70 con 0x7f760c06c650 2024-04-26T00:50:49.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7608ff9640 1 -- 172.21.15.6:0/4233937081 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7f75fc0160f0 con 0x7f760c06c650 2024-04-26T00:50:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7611d95640 10 mgrc shutdown 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 msgr2=0x7f75ec09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 0x7f75ec09b800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f760c0b19c0 tx=0x7f75f4007e40 comp rx=0 tx=0).stop 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 msgr2=0x7f760c1429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.796+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0ae040 tx=0x7f75fc019180 comp rx=0 tx=0).stop 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 shutdown_connections 2024-04-26T00:50:49.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75ec099340 0x7f75ec09b800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f760c0aacf0 0x7f760c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f760c0b2d80 0x7f760c0abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 --2- 172.21.15.6:0/4233937081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f760c06c650 0x7f760c1429a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 >> 172.21.15.6:0/4233937081 conn(0x7f760c0b71a0 msgr2=0x7f760c0b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 shutdown_connections 2024-04-26T00:50:49.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.800+0000 7f7611d95640 1 -- 172.21.15.6:0/4233937081 wait complete. 2024-04-26T00:50:49.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T00:50:49.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T00:50:49.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T00:50:49.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T00:50:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.920+0000 7f16cceec640 1 Processor -- start 2024-04-26T00:50:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 -- start start 2024-04-26T00:50:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 0x7f16c80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 Processor -- start 2024-04-26T00:50:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 -- start start 2024-04-26T00:50:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 0x7f16c814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16c80a7850 0x7f16c8144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56976/0 (socket says 172.21.15.6:56976) 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c659c640 1 -- 172.21.15.6:0/4003336061 learned_addr learned my addr 172.21.15.6:0/4003336061 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4003336061 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 0x7f16c80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c6d9d640 1 --2- 172.21.15.6:0/4003336061 >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 0x7f16c814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c8148740 con 0x7f16c80a7850 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f16c80a7c30 con 0x7f16c814d780 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f16c8071a10 con 0x7f16c80aa170 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c559a640 1 -- 172.21.15.6:0/4003336061 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377180278 0 0) 0x7f16c8148740 con 0x7f16c80a7850 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4003336061 >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 msgr2=0x7f16c814fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4003336061 >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 0x7f16c814fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4003336061 >> v1:172.21.15.6:6789/0 conn(0x7f16c80a7850 legacy=0x7f16c8144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4003336061 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c81489e0 con 0x7f16c80aa170 2024-04-26T00:50:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c6d9d640 1 --2- 172.21.15.6:0/4003336061 >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 0x7f16c814fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:49.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642413bee0 con 0x7f64240b3270 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f64240a9830 con 0x7f642413b9e0 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64297ee640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f642413c180 con 0x7f64240a9450 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64227fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60696/0 (socket says 172.21.15.6:60696) 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64227fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37404/0 (socket says 172.21.15.6:37404) 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 -- 172.21.15.6:0/841201144 learned_addr learned my addr 172.21.15.6:0/841201144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 -- 172.21.15.6:0/841201144 >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 msgr2=0x7f64240b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 --2- 172.21.15.6:0/841201144 >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 -- 172.21.15.6:0/841201144 >> v1:172.21.15.188:6789/0 conn(0x7f64240b3270 legacy=0x7f642406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f6422ffd640 1 -- 172.21.15.6:0/841201144 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64240b4e00 con 0x7f64240a9450 2024-04-26T00:50:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f64227fc640 1 --2- 172.21.15.6:0/841201144 >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4003336061 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 0x7f16c80714d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36b5b3e4cbc20cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c559a640 1 -- 172.21.15.6:0/4003336061 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0b0070 con 0x7f16c80aa170 2024-04-26T00:50:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c559a640 1 -- 172.21.15.6:0/4003336061 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0ab600 con 0x7f16c80aa170 2024-04-26T00:50:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.924+0000 7f16c559a640 1 -- 172.21.15.6:0/4003336061 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ab9d0 con 0x7f16c80aa170 2024-04-26T00:50:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 Processor -- start 2024-04-26T00:50:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 -- start start 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 msgr2=0x7f16c80714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- 172.21.15.6:0/4003336061 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 0x7f16c80714d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c440 comp rx=0 tx=0).stop 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 shutdown_connections 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- 172.21.15.6:0/4003336061 >> v2:172.21.15.6:3300/0 conn(0x7f16c814d780 0x7f16c814fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- 172.21.15.6:0/4003336061 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80aa170 0x7f16c80714d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 >> 172.21.15.6:0/4003336061 conn(0x7f16c806e430 msgr2=0x7f16c806f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 shutdown_connections 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- 172.21.15.6:0/4003336061 wait complete. 2024-04-26T00:50:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 Processor -- start 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 -- start start 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7f14135e90 0x7f7f140ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f14072620 0x7f7f1406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7f140a8310 con 0x7f7f14072620 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7f141353b0 con 0x7f7f14135e90 2024-04-26T00:50:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f1a7cf640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7f14135650 con 0x7f7f140721e0 2024-04-26T00:50:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f6422ffd640 1 --2- 172.21.15.6:0/841201144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6418009870 tx=0x7f641801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc2443cc316c710 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60710/0 (socket says 172.21.15.6:60710) 2024-04-26T00:50:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/1235634543 learned_addr learned my addr 172.21.15.6:0/1235634543 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f6421ffb640 1 -- 172.21.15.6:0/841201144 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180b1070 con 0x7f64240a9450 2024-04-26T00:50:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f6421ffb640 1 -- 172.21.15.6:0/841201144 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64180ac620 con 0x7f64240a9450 2024-04-26T00:50:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 0x7f08080a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0808073290 0x7f080814c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08080728d0 con 0x7f080806d4b0 2024-04-26T00:50:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f080806d890 con 0x7f0808073290 2024-04-26T00:50:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 Processor -- start 2024-04-26T00:50:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080d154640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0808071f30 con 0x7f0808072430 2024-04-26T00:50:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- start start 2024-04-26T00:50:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f07fffff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 0x7f08080a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0808073290 0x7f080814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0808073290 0x7f080814c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37412/0 (socket says 172.21.15.6:37412) 2024-04-26T00:50:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f07fffff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 0x7f08080a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60714/0 (socket says 172.21.15.6:60714) 2024-04-26T00:50:49.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 -- 172.21.15.6:0/4007009132 learned_addr learned my addr 172.21.15.6:0/4007009132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f6421ffb640 1 -- 172.21.15.6:0/841201144 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180ac9f0 con 0x7f64240a9450 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 -- 172.21.15.6:0/841201144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 msgr2=0x7f6424071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 --2- 172.21.15.6:0/841201144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6418009870 tx=0x7f641801c3e0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 -- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 msgr2=0x7f08080a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 --2- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 0x7f08080a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 -- 172.21.15.6:0/4007009132 >> v1:172.21.15.188:6789/0 conn(0x7f080806d4b0 legacy=0x7f0808071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f080759e640 1 -- 172.21.15.6:0/4007009132 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0808072b90 con 0x7f0808073290 2024-04-26T00:50:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 -- 172.21.15.6:0/841201144 shutdown_connections 2024-04-26T00:50:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 --2- 172.21.15.6:0/841201144 >> v2:172.21.15.6:3300/0 conn(0x7f642413b9e0 0x7f64240b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 --2- 172.21.15.6:0/841201144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f64240a9450 0x7f6424071270 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6418009870 tx=0x7f641801c3e0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f64297ee640 1 -- 172.21.15.6:0/841201144 >> 172.21.15.6:0/841201144 conn(0x7f64240b3da0 msgr2=0x7f64240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80a7850 0x7f16c8143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 0x7f16c80a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16c8138c50 0x7f16c8141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16c80700f0 con 0x7f16c814d780 2024-04-26T00:50:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16c806ba30 con 0x7f16c8138c50 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16cceec640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f16c8070270 con 0x7f16c80a7850 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 0x7f16c80a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 0x7f16c80a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37426/0 (socket says 172.21.15.6:37426) 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4112950125 learned_addr learned my addr 172.21.15.6:0/4112950125 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c659c640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80a7850 0x7f16c8143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c6d9d640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16c8138c50 0x7f16c8141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80a7850 msgr2=0x7f16c8143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80a7850 0x7f16c8143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16c8138c50 msgr2=0x7f16c8141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16c8138c50 0x7f16c8141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c80b6d90 con 0x7f16c814d780 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c659c640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16c80a7850 0x7f16c8143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16c5d9b640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 0x7f16c80a61a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/1235634543 >> v2:172.21.15.188:3300/0 conn(0x7f7f14135e90 msgr2=0x7f7f140ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/1235634543 >> v2:172.21.15.188:3300/0 conn(0x7f7f14135e90 0x7f7f140ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/1235634543 >> v2:172.21.15.6:3300/0 conn(0x7f7f14072620 msgr2=0x7f7f1406bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/1235634543 >> v2:172.21.15.6:3300/0 conn(0x7f7f14072620 0x7f7f1406bf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/1235634543 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f14135910 con 0x7f7f140721e0 2024-04-26T00:50:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/1235634543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f140a7ff0 tx=0x7f7efc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99500097c1705cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.928+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ba070 con 0x7f16c814d780 2024-04-26T00:50:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0b43f0 con 0x7f16c814d780 2024-04-26T00:50:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c80b8090 con 0x7f16c814d780 2024-04-26T00:50:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0b0040 con 0x7f16c814d780 2024-04-26T00:50:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f137fe640 1 -- 172.21.15.6:0/1235634543 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b0070 con 0x7f7f140721e0 2024-04-26T00:50:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c80b7300 con 0x7f16c814d780 2024-04-26T00:50:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f137fe640 1 -- 172.21.15.6:0/1235634543 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0ab600 con 0x7f7f140721e0 2024-04-26T00:50:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f137fe640 1 -- 172.21.15.6:0/1235634543 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0ab9d0 con 0x7f7f140721e0 2024-04-26T00:50:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- 172.21.15.6:0/841201144 shutdown_connections 2024-04-26T00:50:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- 172.21.15.6:0/841201144 wait complete. 2024-04-26T00:50:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/1235634543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 msgr2=0x7f7f1406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/1235634543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f140a7ff0 tx=0x7f7efc01c490 comp rx=0 tx=0).stop 2024-04-26T00:50:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16c8143d70 con 0x7f16c814d780 2024-04-26T00:50:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/1235634543 shutdown_connections 2024-04-26T00:50:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/1235634543 >> v2:172.21.15.6:3300/0 conn(0x7f7f14072620 0x7f7f1406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/1235634543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f140721e0 0x7f7f1406ba30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/1235634543 >> v2:172.21.15.188:3300/0 conn(0x7f7f14135e90 0x7f7f140ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080759e640 1 --2- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808073290 0x7f080814c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e50 tx=0x7f080001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67f58d4eb487b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/1235634543 >> 172.21.15.6:0/1235634543 conn(0x7f7f1406f250 msgr2=0x7f7f1406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/1235634543 shutdown_connections 2024-04-26T00:50:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/1235634543 wait complete. 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080659c640 1 -- 172.21.15.6:0/4007009132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000a5900 con 0x7f0808073290 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080659c640 1 -- 172.21.15.6:0/4007009132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000a5aa0 con 0x7f0808073290 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080659c640 1 -- 172.21.15.6:0/4007009132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000ad3f0 con 0x7f0808073290 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 Processor -- start 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- start start 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f16bc0bd070 con 0x7f16c814d780 2024-04-26T00:50:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 Processor -- start 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64240b3270 0x7f64241e2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f642413b9e0 0x7f642413a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 0x7f64240ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6424157040 con 0x7f6424133310 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6424156ec0 con 0x7f64240b3270 2024-04-26T00:50:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64297ee640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f64241571c0 con 0x7f642413b9e0 2024-04-26T00:50:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 -- start start 2024-04-26T00:50:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 -- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808073290 msgr2=0x7f080814c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 --2- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808073290 0x7f080814c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e50 tx=0x7f080001ca50 comp rx=0 tx=0).stop 2024-04-26T00:50:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 0x7f64240ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 0x7f64240ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37436/0 (socket says 172.21.15.6:37436) 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64227fc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f642413b9e0 0x7f642413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 -- 172.21.15.6:0/2525729781 learned_addr learned my addr 172.21.15.6:0/2525729781 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 -- 172.21.15.6:0/4007009132 shutdown_connections 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 --2- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808073290 0x7f080814c470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 --2- 172.21.15.6:0/4007009132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808072430 0x7f08080a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 -- 172.21.15.6:0/4007009132 >> 172.21.15.6:0/4007009132 conn(0x7f080806f250 msgr2=0x7f080806cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 -- 172.21.15.6:0/4007009132 shutdown_connections 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f6422ffd640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64240b3270 0x7f64241e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 -- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f642413b9e0 msgr2=0x7f642413a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f642413b9e0 0x7f642413a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 -- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64240b3270 msgr2=0x7f64241e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64240b3270 0x7f64241e2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64240ac450 con 0x7f6424133310 2024-04-26T00:50:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16b6ffd640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f16a8099370 0x7f16a809b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f64237fe640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 0x7f64240ab8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c780 tx=0x7f641c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f16c659c640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f16a8099370 0x7f16a809b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f7f1a7cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f140721e0 0x7f7f140b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 0x7f7f1413cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c017070 con 0x7f6424133310 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641c003db0 con 0x7f6424133310 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c0052b0 con 0x7f6424133310 2024-04-26T00:50:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241e2e50 con 0x7f6424133310 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 0x7f7f1413cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 0x7f7f1413cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37444/0 (socket says 172.21.15.6:37444) 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f14135e90 0x7f7f141499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f13fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f140721e0 0x7f7f140b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f13fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f140721e0 0x7f7f140b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.6:50638/0 (socket says 172.21.15.6:50638) 2024-04-26T00:50:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642413ac50 con 0x7f6424133310 2024-04-26T00:50:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.932+0000 7f080d154640 1 -- 172.21.15.6:0/4007009132 wait complete. 2024-04-26T00:50:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f18d6c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f14135e90 0x7f7f141499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f18d6c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f14135e90 0x7f7f141499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60742/0 (socket says 172.21.15.6:60742) 2024-04-26T00:50:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 Processor -- start 2024-04-26T00:50:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/3532069023 learned_addr learned my addr 172.21.15.6:0/3532069023 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f14139530 con 0x7f7f14072620 2024-04-26T00:50:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7f141393b0 con 0x7f7f140721e0 2024-04-26T00:50:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7f14073580 con 0x7f7f14135e90 2024-04-26T00:50:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f642406db70 con 0x7f6424133310 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 -- start start 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080806d4b0 0x7f08080a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808072430 0x7f080812f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 0x7f080812f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f080814f690 con 0x7f0808072430 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f080814f510 con 0x7f080806d4b0 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080d154640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f080814f810 con 0x7f0808073290 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 0x7f080812f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 0x7f080812f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60756/0 (socket says 172.21.15.6:60756) 2024-04-26T00:50:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 -- 172.21.15.6:0/1909586690 learned_addr learned my addr 172.21.15.6:0/1909586690 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f07fffff640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808072430 0x7f080812f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f0806d9d640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080806d4b0 0x7f08080a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f14135e90 msgr2=0x7f7f141499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f14135e90 0x7f7f141499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f140721e0 msgr2=0x7f7f140b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f140721e0 0x7f7f140b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1413d820 con 0x7f7f14072620 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f0b7fe640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 0x7f7f1413cdc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ae040 tx=0x7f7efc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b0040 con 0x7f7f14072620 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0aa420 con 0x7f7f14072620 2024-04-26T00:50:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0aa810 con 0x7f7f14072620 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f16bc15b9d0 con 0x7f16c814d780 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16c659c640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f16a8099370 0x7f16a809b830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16b8007fd0 tx=0x7f16b8007d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16b6ffd640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] conn(0x7f16a80a0ed0 0x7f16a80a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16a80a39e0 con 0x7f16a80a0ed0 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f16bc15be60 con 0x7f16c814d780 2024-04-26T00:50:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16c6d9d640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] conn(0x7f16a80a0ed0 0x7f16a80a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1413dae0 con 0x7f7f14072620 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1414ada0 con 0x7f7f14072620 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 -- 172.21.15.6:0/1909586690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080806d4b0 msgr2=0x7f08080a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080806d4b0 0x7f08080a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 -- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808072430 msgr2=0x7f080812f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0808072430 0x7f080812f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0808131520 con 0x7f0808073290 2024-04-26T00:50:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f1406db70 con 0x7f7f14072620 2024-04-26T00:50:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f080759e640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 0x7f080812f960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f080001b100 tx=0x7f08000197f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f16c6d9d640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] conn(0x7f16a80a0ed0 0x7f16a80a3310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f641c01a070 con 0x7f6424133310 2024-04-26T00:50:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.936+0000 7f640b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f64100994c0 0x7f641009b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f641c0c2110 con 0x7f6424133310 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] conn(0x7f64100a1020 0x7f64100a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f641c017e70 con 0x7f64100a1020 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f641c0c2500 con 0x7f6424133310 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f6422ffd640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f64100994c0 0x7f641009b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f64227fc640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] conn(0x7f64100a1020 0x7f64100a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f6422ffd640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f64100994c0 0x7f641009b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64180ae000 tx=0x7f6418008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f64227fc640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] conn(0x7f64100a1020 0x7f64100a3460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f7efc0bc020 con 0x7f7f14072620 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7ef40994c0 0x7f7ef409b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f13fff640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7ef40994c0 0x7f7ef409b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f7efc15c700 con 0x7f7f14072620 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] conn(0x7f7ef40a5430 0x7f7ef40a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7efc0c0e70 con 0x7f7ef40a5430 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7efc15caf0 con 0x7f7f14072620 2024-04-26T00:50:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== osd.3 v2:172.21.15.188:6808/408195122 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16a80a39e0 con 0x7f16a80a0ed0 2024-04-26T00:50:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f18d6c640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] conn(0x7f7ef40a5430 0x7f7ef40a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f13fff640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7ef40994c0 0x7f7ef409b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f040098f0 tx=0x7f7f04006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000b8670 con 0x7f0808073290 2024-04-26T00:50:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000be070 con 0x7f0808073290 2024-04-26T00:50:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000b8a70 con 0x7f0808073290 2024-04-26T00:50:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08081317e0 con 0x7f0808073290 2024-04-26T00:50:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0808134ed0 con 0x7f0808073290 2024-04-26T00:50:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08081304b0 con 0x7f0808073290 2024-04-26T00:50:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f7f18d6c640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] conn(0x7f7ef40a5430 0x7f7ef40a7870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.940+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== osd.1 v2:172.21.15.188:6800/635512805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f641c017e70 con 0x7f64100a1020 2024-04-26T00:50:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== osd.2 v2:172.21.15.188:6809/1913368330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7efc0c0e70 con 0x7f7ef40a5430 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f08000b8c10 con 0x7f0808073290 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f07e8099340 0x7f07e809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f080015dd70 con 0x7f0808073290 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f0806d9d640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f07e8099340 0x7f07e809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] conn(0x7f07e80a0ea0 0x7f07e80a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07e80a39b0 con 0x7f07e80a0ea0 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f080015e200 con 0x7f0808073290 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.944+0000 7f0806d9d640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f07e8099340 0x7f07e809b800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07f8007fd0 tx=0x7f07f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.952+0000 7f07fffff640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] conn(0x7f07e80a0ea0 0x7f07e80a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.952+0000 7f07fffff640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] conn(0x7f07e80a0ea0 0x7f07e80a32e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.952+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== osd.0 v2:172.21.15.6:6800/1790946182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07e80a39b0 con 0x7f07e80a0ea0 2024-04-26T00:50:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 --> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16c806db70 con 0x7f16a80a0ed0 2024-04-26T00:50:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16b6ffd640 1 -- 172.21.15.6:0/4112950125 <== osd.3 v2:172.21.15.188:6808/408195122 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f16c806db70 con 0x7f16a80a0ed0 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] conn(0x7f16a80a0ed0 msgr2=0x7f16a80a3310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.188:6808/408195122,v1:172.21.15.188:6810/408195122] conn(0x7f16a80a0ed0 0x7f16a80a3310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 10 mgrc shutdown 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f16a8099370 msgr2=0x7f16a809b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f16a8099370 0x7f16a809b830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16b8007fd0 tx=0x7f16b8007d60 comp rx=0 tx=0).stop 2024-04-26T00:50:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 msgr2=0x7f16c80a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 --2- 172.21.15.6:0/4112950125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c814d780 0x7f16c80a61a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc0191e0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16c6d9d640 1 -- 172.21.15.6:0/4112950125 reap_dead start 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 shutdown_connections 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 >> 172.21.15.6:0/4112950125 conn(0x7f16c806e430 msgr2=0x7f16c8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 shutdown_connections 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f16cceec640 1 -- 172.21.15.6:0/4112950125 wait complete. 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 --> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f642406db70 con 0x7f64100a1020 2024-04-26T00:50:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f640b7fe640 1 -- 172.21.15.6:0/2525729781 <== osd.1 v2:172.21.15.188:6800/635512805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f642406db70 con 0x7f64100a1020 2024-04-26T00:50:49.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] conn(0x7f64100a1020 msgr2=0x7f64100a3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.956+0000 7f64297ee640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.188:6800/635512805,v1:172.21.15.188:6801/635512805] conn(0x7f64100a1020 0x7f64100a3460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 10 mgrc shutdown 2024-04-26T00:50:49.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f64100994c0 msgr2=0x7f641009b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f64100994c0 0x7f641009b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64180ae000 tx=0x7f6418008040 comp rx=0 tx=0).stop 2024-04-26T00:50:49.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 msgr2=0x7f64240ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 --2- 172.21.15.6:0/2525729781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6424133310 0x7f64240ab8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c780 tx=0x7f641c00cc40 comp rx=0 tx=0).stop 2024-04-26T00:50:49.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64237fe640 1 -- 172.21.15.6:0/2525729781 reap_dead start 2024-04-26T00:50:49.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 --> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f14145520 con 0x7f7ef40a5430 2024-04-26T00:50:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 shutdown_connections 2024-04-26T00:50:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 >> 172.21.15.6:0/2525729781 conn(0x7f64240b3da0 msgr2=0x7f6424136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 shutdown_connections 2024-04-26T00:50:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f64297ee640 1 -- 172.21.15.6:0/2525729781 wait complete. 2024-04-26T00:50:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f117fa640 1 -- 172.21.15.6:0/3532069023 <== osd.2 v2:172.21.15.188:6809/1913368330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f14145520 con 0x7f7ef40a5430 2024-04-26T00:50:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] conn(0x7f7ef40a5430 msgr2=0x7f7ef40a7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.188:6809/1913368330,v1:172.21.15.188:6811/1913368330] conn(0x7f7ef40a5430 0x7f7ef40a7870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 10 mgrc shutdown 2024-04-26T00:50:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7ef40994c0 msgr2=0x7f7ef409b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f7ef40994c0 0x7f7ef409b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f040098f0 tx=0x7f7f04006f90 comp rx=0 tx=0).stop 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 msgr2=0x7f7f1413cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 --2- 172.21.15.6:0/3532069023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f14072620 0x7f7f1413cdc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ae040 tx=0x7f7efc019230 comp rx=0 tx=0).stop 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f18d6c640 1 -- 172.21.15.6:0/3532069023 reap_dead start 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 shutdown_connections 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 >> 172.21.15.6:0/3532069023 conn(0x7f7f1406f250 msgr2=0x7f7f1406bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 shutdown_connections 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.960+0000 7f7f1a7cf640 1 -- 172.21.15.6:0/3532069023 wait complete. 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 --> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0808130160 con 0x7f07e80a0ea0 2024-04-26T00:50:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f07ff7fe640 1 -- 172.21.15.6:0/1909586690 <== osd.0 v2:172.21.15.6:6800/1790946182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0808130160 con 0x7f07e80a0ea0 2024-04-26T00:50:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] conn(0x7f07e80a0ea0 msgr2=0x7f07e80a32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6800/1790946182,v1:172.21.15.6:6801/1790946182] conn(0x7f07e80a0ea0 0x7f07e80a32e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 10 mgrc shutdown 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f07e8099340 msgr2=0x7f07e809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f07e8099340 0x7f07e809b800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07f8007fd0 tx=0x7f07f8009040 comp rx=0 tx=0).stop 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 msgr2=0x7f080812f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 --2- 172.21.15.6:0/1909586690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0808073290 0x7f080812f960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f080001b100 tx=0x7f08000197f0 comp rx=0 tx=0).stop 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080759e640 1 -- 172.21.15.6:0/1909586690 reap_dead start 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 shutdown_connections 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 >> 172.21.15.6:0/1909586690 conn(0x7f080806f250 msgr2=0x7f0808135570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 shutdown_connections 2024-04-26T00:50:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:49.968+0000 7f080d154640 1 -- 172.21.15.6:0/1909586690 wait complete. 2024-04-26T00:50:49.986 INFO:teuthology.orchestra.run.smithi006.stdout:38654705673 2024-04-26T00:50:49.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T00:50:49.989 INFO:teuthology.orchestra.run.smithi006.stdout:38654705671 2024-04-26T00:50:49.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T00:50:49.991 INFO:teuthology.orchestra.run.smithi006.stdout:38654705671 2024-04-26T00:50:49.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T00:50:49.999 INFO:teuthology.orchestra.run.smithi006.stdout:38654705673 2024-04-26T00:50:49.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T00:50:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 Processor -- start 2024-04-26T00:50:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 -- start start 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 0x7f90681428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90681465d0 con 0x7f9068142480 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9068146870 con 0x7f906806bb10 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f906d3c2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f906806bef0 con 0x7f90680aeae0 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 0x7f90681428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90667fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9068142480 0x7f90680ae3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56978/0 (socket says 172.21.15.6:56978) 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90667fc640 1 -- 172.21.15.6:0/582709366 learned_addr learned my addr 172.21.15.6:0/582709366 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90677fe640 1 -- 172.21.15.6:0/582709366 >> v1:172.21.15.188:6789/0 conn(0x7f906806bb10 legacy=0x7f90680ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:50.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90677fe640 1 -- 172.21.15.6:0/582709366 >> v1:172.21.15.6:6789/0 conn(0x7f9068142480 legacy=0x7f90680ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f90677fe640 1 -- 172.21.15.6:0/582709366 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90680ad460 con 0x7f90680aeae0 2024-04-26T00:50:50.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.088+0000 7f9065ffb640 1 -- 172.21.15.6:0/582709366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619738378 0 0) 0x7f90681465d0 con 0x7f9068142480 2024-04-26T00:50:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f90677fe640 1 --2- 172.21.15.6:0/582709366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 0x7f90681428d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9060009d90 tx=0x7f906001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05bd77439d009be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f9065ffb640 1 -- 172.21.15.6:0/582709366 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600b2070 con 0x7f90680aeae0 2024-04-26T00:50:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f9065ffb640 1 -- 172.21.15.6:0/582709366 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90600a5850 con 0x7f90680aeae0 2024-04-26T00:50:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f9065ffb640 1 -- 172.21.15.6:0/582709366 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600a5c20 con 0x7f90680aeae0 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- 172.21.15.6:0/582709366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 msgr2=0x7f90681428d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 --2- 172.21.15.6:0/582709366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 0x7f90681428d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9060009d90 tx=0x7f906001c880 comp rx=0 tx=0).stop 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- 172.21.15.6:0/582709366 shutdown_connections 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 --2- 172.21.15.6:0/582709366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90680aeae0 0x7f90681428d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- 172.21.15.6:0/582709366 >> 172.21.15.6:0/582709366 conn(0x7f9068070810 msgr2=0x7f906806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- 172.21.15.6:0/582709366 shutdown_connections 2024-04-26T00:50:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- 172.21.15.6:0/582709366 wait complete. 2024-04-26T00:50:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 Processor -- start 2024-04-26T00:50:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- start start 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 0x7f906814e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90680aeae0 0x7f9068140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90681517b0 con 0x7f906806bb10 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9068151630 con 0x7f90680aeae0 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f906d3c2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f9068151930 con 0x7f9068142480 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f90677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f90677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60762/0 (socket says 172.21.15.6:60762) 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f90677fe640 1 -- 172.21.15.6:0/3096769438 learned_addr learned my addr 172.21.15.6:0/3096769438 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f9066ffd640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 0x7f906814e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.092+0000 7f90667fc640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90680aeae0 0x7f9068140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 -- 172.21.15.6:0/3096769438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90680aeae0 msgr2=0x7f9068140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90680aeae0 0x7f9068140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 -- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 msgr2=0x7f906814e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 0x7f906814e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 -- 172.21.15.6:0/3096769438 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906813d0d0 con 0x7f9068142480 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f9066ffd640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 0x7f906814e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f90677fe640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90600b0040 tx=0x7f9060019620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600bd020 con 0x7f9068142480 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90600adaf0 con 0x7f9068142480 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f906d3c2640 1 -- 172.21.15.6:0/3096769438 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906806f9a0 con 0x7f9068142480 2024-04-26T00:50:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f906d3c2640 1 -- 172.21.15.6:0/3096769438 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90680a2100 con 0x7f9068142480 2024-04-26T00:50:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90600b2040 con 0x7f9068142480 2024-04-26T00:50:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 Processor -- start 2024-04-26T00:50:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 -- start start 2024-04-26T00:50:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906806db70 con 0x7f9068142480 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53f80a6d80 0x7f53f80a4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 0x7f53f8148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53fcea5640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53fcea5640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60778/0 (socket says 172.21.15.6:60778) 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53fd6a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53f80a6d80 0x7f53f80a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53fd6a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53f80a6d80 0x7f53f80a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37472/0 (socket says 172.21.15.6:37472) 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53fcea5640 1 -- 172.21.15.6:0/2570323499 learned_addr learned my addr 172.21.15.6:0/2570323499 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f53f806cf90 con 0x7f53f80a6d80 2024-04-26T00:50:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f53f80a7160 con 0x7f53f806cb00 2024-04-26T00:50:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f53f813b280 con 0x7f53f806c180 2024-04-26T00:50:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f90600c0020 con 0x7f9068142480 2024-04-26T00:50:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.096+0000 7f904f7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 -- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 msgr2=0x7f53f806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 -- 172.21.15.6:0/2570323499 >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 msgr2=0x7f53f8148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fdea7640 1 --2- 172.21.15.6:0/2570323499 >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 0x7f53f8148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/2570323499 >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 0x7f53f8148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 -- 172.21.15.6:0/2570323499 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f806b3a0 con 0x7f53f80a6d80 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f904f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f904f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f904f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f904f7fe640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 0x7f905409b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f906015d6d0 con 0x7f9068142480 2024-04-26T00:50:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f9066ffd640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 0x7f905409b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f9066ffd640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 0x7f905409b880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9058007fd0 tx=0x7f9058007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fdea7640 1 --2- 172.21.15.6:0/2570323499 >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 0x7f53f8148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f80a6d80 0x7f53f80a4200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53f813bb70 tx=0x7f53f401c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1a7035e711d927 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53effff640 1 -- 172.21.15.6:0/2570323499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40b0070 con 0x7f53f80a6d80 2024-04-26T00:50:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53effff640 1 -- 172.21.15.6:0/2570323499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f40ab600 con 0x7f53f80a6d80 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53effff640 1 -- 172.21.15.6:0/2570323499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40ab9d0 con 0x7f53f80a6d80 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f80a6d80 msgr2=0x7f53f80a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 --2- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f80a6d80 0x7f53f80a4200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53f813bb70 tx=0x7f53f401c110 comp rx=0 tx=0).stop 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 shutdown_connections 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 --2- 172.21.15.6:0/2570323499 >> v2:172.21.15.188:3300/0 conn(0x7f53f806cb00 0x7f53f8148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 --2- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 --2- 172.21.15.6:0/2570323499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f80a6d80 0x7f53f80a4200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.100+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 >> 172.21.15.6:0/2570323499 conn(0x7f53f80b71a0 msgr2=0x7f53f80b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 shutdown_connections 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/2570323499 wait complete. 2024-04-26T00:50:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f90600c7030 con 0x7f9068142480 2024-04-26T00:50:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 Processor -- start 2024-04-26T00:50:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- start start 2024-04-26T00:50:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f806cb00 0x7f53f8136970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 0x7f53f8136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60792/0 (socket says 172.21.15.6:60792) 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 -- 172.21.15.6:0/1829357303 learned_addr learned my addr 172.21.15.6:0/1829357303 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80a48c0 con 0x7f53f806cb00 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80a4740 con 0x7f53f80a6d80 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fcea5640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f806cb00 0x7f53f8136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f53f81518d0 con 0x7f53f806c180 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fdea7640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 0x7f53f8136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 -- 172.21.15.6:0/1829357303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 msgr2=0x7f53f8136eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 0x7f53f8136eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 -- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f806cb00 msgr2=0x7f53f8136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f806cb00 0x7f53f8136970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f81366d0 con 0x7f53f806c180 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fdea7640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 0x7f53f8136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53fd6a6640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f53f40097c0 tx=0x7f53f401a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40b0050 con 0x7f53f806c180 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f40bc070 con 0x7f53f806c180 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f80a2db0 con 0x7f53f806c180 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.104+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40aac00 con 0x7f53f806c180 2024-04-26T00:50:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f80a00b0 con 0x7f53f806c180 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f806db70 con 0x7f53f806c180 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f53f40c1460 con 0x7f53f806c180 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 0x7f53dc09b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f53f415cf30 con 0x7f53f806c180 2024-04-26T00:50:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53fcea5640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 0x7f53dc09b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.108+0000 7f53fcea5640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 0x7f53dc09b780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53f80a30b0 tx=0x7f53e8009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.116+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f53f4016050 con 0x7f53f806c180 2024-04-26T00:50:50.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 Processor -- start 2024-04-26T00:50:50.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 -- start start 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 0x7f920c0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920c06c030 0x7f920c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0a48d0 con 0x7f920c13b6b0 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f920c0a7160 con 0x7f920c06c030 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9213758640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f920c0a4b60 con 0x7f920c0a6d80 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920c06c030 0x7f920c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920c06c030 0x7f920c06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37498/0 (socket says 172.21.15.6:37498) 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 -- 172.21.15.6:0/2553222265 learned_addr learned my addr 172.21.15.6:0/2553222265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f92114f4640 1 --2- 172.21.15.6:0/2553222265 >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 0x7f920c0a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 -- 172.21.15.6:0/2553222265 >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 msgr2=0x7f920c0a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 --2- 172.21.15.6:0/2553222265 >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 0x7f920c0a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 -- 172.21.15.6:0/2553222265 >> v1:172.21.15.188:6789/0 conn(0x7f920c13b6b0 legacy=0x7f920c0a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f9211cf5640 1 -- 172.21.15.6:0/2553222265 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c06b8c0 con 0x7f920c06c030 2024-04-26T00:50:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.156+0000 7f92114f4640 1 --2- 172.21.15.6:0/2553222265 >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 0x7f920c0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9211cf5640 1 --2- 172.21.15.6:0/2553222265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c06c030 0x7f920c06c440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f920c0a7710 tx=0x7f920401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325c4ce3ca079cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9203fff640 1 -- 172.21.15.6:0/2553222265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92040a6660 con 0x7f920c06c030 2024-04-26T00:50:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9203fff640 1 -- 172.21.15.6:0/2553222265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92040a6800 con 0x7f920c06c030 2024-04-26T00:50:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9203fff640 1 -- 172.21.15.6:0/2553222265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92040a6bd0 con 0x7f920c06c030 2024-04-26T00:50:50.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/2553222265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c06c030 msgr2=0x7f920c06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- 172.21.15.6:0/2553222265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c06c030 0x7f920c06c440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f920c0a7710 tx=0x7f920401ca40 comp rx=0 tx=0).stop 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/2553222265 shutdown_connections 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- 172.21.15.6:0/2553222265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c06c030 0x7f920c06c440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- 172.21.15.6:0/2553222265 >> v2:172.21.15.188:3300/0 conn(0x7f920c0a6d80 0x7f920c0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/2553222265 >> 172.21.15.6:0/2553222265 conn(0x7f920c0b71a0 msgr2=0x7f920c0b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/2553222265 shutdown_connections 2024-04-26T00:50:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/2553222265 wait complete. 2024-04-26T00:50:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 Processor -- start 2024-04-26T00:50:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- start start 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c0a6d80 0x7f920c148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f92114f4640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f92114f4640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60794/0 (socket says 172.21.15.6:60794) 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f92114f4640 1 -- 172.21.15.6:0/1914739927 learned_addr learned my addr 172.21.15.6:0/1914739927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c13b6b0 0x7f920c071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f920c151a50 con 0x7f920c0a6d80 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1518d0 con 0x7f920c13b6b0 2024-04-26T00:50:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.160+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f920c151bd0 con 0x7f920c06c030 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9210cf3640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c0a6d80 0x7f920c148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 -- 172.21.15.6:0/1914739927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c13b6b0 msgr2=0x7f920c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c13b6b0 0x7f920c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 -- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c0a6d80 msgr2=0x7f920c148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c0a6d80 0x7f920c148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1e0110 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f92114f4640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f920800e840 tx=0x7f920800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208017070 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c1e03b0 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920800c8d0 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208021060 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c1493a0 con 0x7f920c06c030 2024-04-26T00:50:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c06db70 con 0x7f920c06c030 2024-04-26T00:50:50.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f920801a070 con 0x7f920c06c030 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.164+0000 7f9201ffb640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 0x7f91f009b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.168+0000 7f9210cf3640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 0x7f91f009b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.168+0000 7f9210cf3640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 0x7f91f009b830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f920c09f8f0 tx=0x7f91fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.172+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f9208090f80 con 0x7f920c06c030 2024-04-26T00:50:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.172+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9208093380 con 0x7f920c06c030 2024-04-26T00:50:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.200+0000 7fe022514640 1 Processor -- start 2024-04-26T00:50:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.200+0000 7fe022514640 1 -- start start 2024-04-26T00:50:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe022514640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 0x7fe01c137f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe022514640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 0x7fe01c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe022514640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe01c137860 con 0x7fe01c06bc90 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe022514640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe01c0b0920 con 0x7fe01c06b8b0 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe022514640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c137b00 con 0x7fe01c13b6f0 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe01bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 0x7fe01c137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe01bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 0x7fe01c137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37522/0 (socket says 172.21.15.6:37522) 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe01bfff640 1 -- 172.21.15.6:0/1105582956 learned_addr learned my addr 172.21.15.6:0/1105582956 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe020ab1640 1 --2- 172.21.15.6:0/1105582956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 0x7fe01c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe020ab1640 1 -- 172.21.15.6:0/1105582956 >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 msgr2=0x7fe01c137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe020ab1640 1 --2- 172.21.15.6:0/1105582956 >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 0x7fe01c137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe020ab1640 1 -- 172.21.15.6:0/1105582956 >> v1:172.21.15.188:6789/0 conn(0x7fe01c06bc90 legacy=0x7fe01c0aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.204+0000 7fe020ab1640 1 -- 172.21.15.6:0/1105582956 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c0aace0 con 0x7fe01c13b6f0 2024-04-26T00:50:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 --2- 172.21.15.6:0/1105582956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 0x7fe01c14f960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe014009d90 tx=0x7fe01401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ee6a2d79404eb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01affd640 1 -- 172.21.15.6:0/1105582956 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140b2070 con 0x7fe01c13b6f0 2024-04-26T00:50:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01affd640 1 -- 172.21.15.6:0/1105582956 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0140a57d0 con 0x7fe01c13b6f0 2024-04-26T00:50:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01affd640 1 -- 172.21.15.6:0/1105582956 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140a5ba0 con 0x7fe01c13b6f0 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- 172.21.15.6:0/1105582956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 msgr2=0x7fe01c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- 172.21.15.6:0/1105582956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 0x7fe01c14f960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe014009d90 tx=0x7fe01401c830 comp rx=0 tx=0).stop 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- 172.21.15.6:0/1105582956 shutdown_connections 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- 172.21.15.6:0/1105582956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c13b6f0 0x7fe01c14f960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- 172.21.15.6:0/1105582956 >> v2:172.21.15.6:3300/0 conn(0x7fe01c06b8b0 0x7fe01c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- 172.21.15.6:0/1105582956 >> 172.21.15.6:0/1105582956 conn(0x7fe01c070810 msgr2=0x7fe01c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- 172.21.15.6:0/1105582956 shutdown_connections 2024-04-26T00:50:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- 172.21.15.6:0/1105582956 wait complete. 2024-04-26T00:50:50.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 Processor -- start 2024-04-26T00:50:50.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- start start 2024-04-26T00:50:50.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 0x7fe01c1368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe01c13b6f0 0x7fe01c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c152840 con 0x7fe01c06b8b0 2024-04-26T00:50:50.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1526c0 con 0x7fe01c13b6f0 2024-04-26T00:50:50.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe022514640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c1529c0 con 0x7fe01c1304b0 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60810/0 (socket says 172.21.15.6:60810) 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 -- 172.21.15.6:0/2417345085 learned_addr learned my addr 172.21.15.6:0/2417345085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01b7fe640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe01c13b6f0 0x7fe01c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 -- 172.21.15.6:0/2417345085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe01c13b6f0 msgr2=0x7fe01c0a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe01c13b6f0 0x7fe01c0a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 -- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 msgr2=0x7fe01c1368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01bfff640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 0x7fe01c1368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 0x7fe01c1368a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe020ab1640 1 -- 172.21.15.6:0/2417345085 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c145d00 con 0x7fe01c1304b0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.208+0000 7fe01bfff640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 0x7fe01c1368a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe020ab1640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0140b0040 tx=0x7fe0140195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140b2050 con 0x7fe01c1304b0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0140be070 con 0x7fe01c1304b0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c0a6950 con 0x7fe01c1304b0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140ad850 con 0x7fe01c1304b0 2024-04-26T00:50:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c12f120 con 0x7fe01c1304b0 2024-04-26T00:50:50.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01c06db70 con 0x7fe01c1304b0 2024-04-26T00:50:50.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fe0140ad9f0 con 0x7fe01c1304b0 2024-04-26T00:50:50.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.212+0000 7fe018ff9640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 0x7fe00809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:50.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.220+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fe0140c2e70 con 0x7fe01c1304b0 2024-04-26T00:50:50.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.220+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe01c145d00 con 0x7fe01c1304b0 2024-04-26T00:50:50.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.220+0000 7fe01bfff640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 0x7fe00809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:50.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.220+0000 7fe01bfff640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 0x7fe00809b800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009ad0 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.280+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f90680723d0 con 0x7f9068142480 2024-04-26T00:50:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.280+0000 7f904f7fe640 1 -- 172.21.15.6:0/3096769438 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9060016500 con 0x7f9068142480 2024-04-26T00:50:50.289 INFO:teuthology.orchestra.run.smithi006.stdout:38654705672 2024-04-26T00:50:50.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 10 mgrc shutdown 2024-04-26T00:50:50.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 msgr2=0x7f905409b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 0x7f905409b880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9058007fd0 tx=0x7f9058007e40 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 msgr2=0x7f906814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90600b0040 tx=0x7f9060019620 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 shutdown_connections 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f90540993c0 0x7f905409b880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9068142480 0x7f906814c9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90680aeae0 0x7f9068140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 --2- 172.21.15.6:0/3096769438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f906806bb10 0x7f906814e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 >> 172.21.15.6:0/3096769438 conn(0x7f9068070810 msgr2=0x7f906813c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 shutdown_connections 2024-04-26T00:50:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.284+0000 7f904d7fa640 1 -- 172.21.15.6:0/3096769438 wait complete. 2024-04-26T00:50:50.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705672 for osd.3 2024-04-26T00:50:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.376+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f53f81470f0 con 0x7f53f806c180 2024-04-26T00:50:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.376+0000 7f53edffb640 1 -- 172.21.15.6:0/1829357303 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53f412dec0 con 0x7f53f806c180 2024-04-26T00:50:50.385 INFO:teuthology.orchestra.run.smithi006.stdout:38654705671 2024-04-26T00:50:50.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 10 mgrc shutdown 2024-04-26T00:50:50.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 msgr2=0x7f53dc09b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 0x7f53dc09b780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53f80a30b0 tx=0x7f53e8009240 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 msgr2=0x7f53f806fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f53f40097c0 tx=0x7f53f401a950 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 shutdown_connections 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f53dc0992c0 0x7f53dc09b780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80a6d80 0x7f53f8136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53f806cb00 0x7f53f8136970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 --2- 172.21.15.6:0/1829357303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53f806c180 0x7f53f806fc70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 >> 172.21.15.6:0/1829357303 conn(0x7f53f80b71a0 msgr2=0x7f53f8147e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 shutdown_connections 2024-04-26T00:50:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.380+0000 7f53ff90a640 1 -- 172.21.15.6:0/1829357303 wait complete. 2024-04-26T00:50:50.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-04-26T00:50:50.403 DEBUG:teuthology.parallel:result is None 2024-04-26T00:50:50.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe01c0a5990 con 0x7fe01c1304b0 2024-04-26T00:50:50.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe018ff9640 1 -- 172.21.15.6:0/2417345085 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe014016540 con 0x7fe01c1304b0 2024-04-26T00:50:50.412 INFO:teuthology.orchestra.run.smithi006.stdout:38654705673 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 10 mgrc shutdown 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 msgr2=0x7fe00809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 0x7fe00809b800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009ad0 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 msgr2=0x7fe01c0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0140b0040 tx=0x7fe0140195d0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 shutdown_connections 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe008099340 0x7fe00809b800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe01c1304b0 0x7fe01c0a6200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe01c13b6f0 0x7fe01c0a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 --2- 172.21.15.6:0/2417345085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe01c06b8b0 0x7fe01c1368a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 >> 172.21.15.6:0/2417345085 conn(0x7fe01c070810 msgr2=0x7fe01c06e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 shutdown_connections 2024-04-26T00:50:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.404+0000 7fe022514640 1 -- 172.21.15.6:0/2417345085 wait complete. 2024-04-26T00:50:50.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.412+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f920c0b57d0 con 0x7f920c06c030 2024-04-26T00:50:50.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9201ffb640 1 -- 172.21.15.6:0/1914739927 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9208092c80 con 0x7f920c06c030 2024-04-26T00:50:50.423 INFO:teuthology.orchestra.run.smithi006.stdout:38654705671 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 10 mgrc shutdown 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 msgr2=0x7f91f009b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 0x7f91f009b830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f920c09f8f0 tx=0x7f91fc009040 comp rx=0 tx=0).stop 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 msgr2=0x7f920c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f920800e840 tx=0x7f920800ed00 comp rx=0 tx=0).stop 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 shutdown_connections 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f91f0099370 0x7f91f009b830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c13b6b0 0x7f920c071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920c0a6d80 0x7f920c148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 --2- 172.21.15.6:0/1914739927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f920c06c030 0x7f920c0b2950 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:50.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 >> 172.21.15.6:0/1914739927 conn(0x7f920c0b71a0 msgr2=0x7f920c0a20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:50.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 shutdown_connections 2024-04-26T00:50:50.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:50.416+0000 7f9213758640 1 -- 172.21.15.6:0/1914739927 wait complete. 2024-04-26T00:50:50.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2024-04-26T00:50:50.429 DEBUG:teuthology.parallel:result is None 2024-04-26T00:50:50.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-04-26T00:50:50.440 DEBUG:teuthology.parallel:result is None 2024-04-26T00:50:51.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:50:51.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:50:51.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T00:50:51.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.432+0000 7f1a932f1640 1 Processor -- start 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.432+0000 7f1a932f1640 1 -- start start 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a932f1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a8c06bb10 0x7f1a8c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a932f1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8c0aabc0 con 0x7f1a8c0a6320 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a932f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8c1433a0 con 0x7f1a8c0a6e40 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a932f1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8c06bef0 con 0x7f1a8c06bb10 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9108d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a8c06bb10 0x7f1a8c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9088c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a8c0a6320 0x7f1a8c0a6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56982/0 (socket says 172.21.15.6:56982) 2024-04-26T00:50:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9088c640 1 -- 172.21.15.6:0/471959532 learned_addr learned my addr 172.21.15.6:0/471959532 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9108d640 1 -- 172.21.15.6:0/471959532 >> v1:172.21.15.188:6789/0 conn(0x7f1a8c0a6e40 legacy=0x7f1a8c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9108d640 1 -- 172.21.15.6:0/471959532 >> v1:172.21.15.6:6789/0 conn(0x7f1a8c0a6320 legacy=0x7f1a8c0a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a83fff640 1 -- 172.21.15.6:0/471959532 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983032459 0 0) 0x7f1a8c0aabc0 con 0x7f1a8c0a6320 2024-04-26T00:50:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.436+0000 7f1a9108d640 1 -- 172.21.15.6:0/471959532 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c143660 con 0x7f1a8c06bb10 2024-04-26T00:50:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9108d640 1 --2- 172.21.15.6:0/471959532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0aa680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14885ce7b6f5e9c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a83fff640 1 -- 172.21.15.6:0/471959532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880b2070 con 0x7f1a8c06bb10 2024-04-26T00:50:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a83fff640 1 -- 172.21.15.6:0/471959532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a57d0 con 0x7f1a8c06bb10 2024-04-26T00:50:51.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a83fff640 1 -- 172.21.15.6:0/471959532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a5ba0 con 0x7f1a8c06bb10 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- 172.21.15.6:0/471959532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c06bb10 msgr2=0x7f1a8c0aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 --2- 172.21.15.6:0/471959532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0aa680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8801c910 comp rx=0 tx=0).stop 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- 172.21.15.6:0/471959532 shutdown_connections 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 --2- 172.21.15.6:0/471959532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0aa680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- 172.21.15.6:0/471959532 >> 172.21.15.6:0/471959532 conn(0x7f1a8c06e400 msgr2=0x7f1a8c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- 172.21.15.6:0/471959532 shutdown_connections 2024-04-26T00:50:51.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- 172.21.15.6:0/471959532 wait complete. 2024-04-26T00:50:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 Processor -- start 2024-04-26T00:50:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- start start 2024-04-26T00:50:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1517b0 con 0x7f1a8c0a6e40 2024-04-26T00:50:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c151630 con 0x7f1a8c06bb10 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a932f1640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8c151930 con 0x7f1a8c0a6320 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9188e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9188e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37552/0 (socket says 172.21.15.6:37552) 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9188e640 1 -- 172.21.15.6:0/3043001314 learned_addr learned my addr 172.21.15.6:0/3043001314 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60812/0 (socket says 172.21.15.6:60812) 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9108d640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 -- 172.21.15.6:0/3043001314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a8c06bb10 msgr2=0x7f1a8c0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 -- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 msgr2=0x7f1a8c0a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 -- 172.21.15.6:0/3043001314 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c0b2ce0 con 0x7f1a8c0a6320 2024-04-26T00:50:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9188e640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a9088c640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c450 tx=0x7f1a7c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.440+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c018070 con 0x7f1a8c0a6320 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0074e0 con 0x7f1a8c0a6320 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c0b1360 con 0x7f1a8c0a6320 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004a30 con 0x7f1a8c0a6320 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c0aff70 con 0x7f1a8c0a6320 2024-04-26T00:50:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8c06db70 con 0x7f1a8c0a6320 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f1a7c01b070 con 0x7f1a8c0a6320 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 0x7f1a7009b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a9108d640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 0x7f1a7009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f1a7c0c18a0 con 0x7f1a8c0a6320 2024-04-26T00:50:51.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.444+0000 7f1a9108d640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 0x7f1a7009b800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.448+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1a7c092830 con 0x7f1a8c0a6320 2024-04-26T00:50:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.604+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1a8c0a8030 con 0x7f1a8c0a6320 2024-04-26T00:50:51.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.604+0000 7f1a81ffb640 1 -- 172.21.15.6:0/3043001314 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a7c092130 con 0x7f1a8c0a6320 2024-04-26T00:50:51.613 INFO:teuthology.orchestra.run.smithi006.stdout:38654705673 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 10 mgrc shutdown 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 msgr2=0x7f1a7009b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 0x7f1a7009b800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880a7070 comp rx=0 tx=0).stop 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 msgr2=0x7f1a8c0b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c450 tx=0x7f1a7c00c910 comp rx=0 tx=0).stop 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 shutdown_connections 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1a70099340 0x7f1a7009b800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8c0a6e40 0x7f1a8c0a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1a8c0a6320 0x7f1a8c0b0b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 --2- 172.21.15.6:0/3043001314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a8c06bb10 0x7f1a8c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 >> 172.21.15.6:0/3043001314 conn(0x7f1a8c06e400 msgr2=0x7f1a8c142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 shutdown_connections 2024-04-26T00:50:51.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.608+0000 7f1a932f1640 1 -- 172.21.15.6:0/3043001314 wait complete. 2024-04-26T00:50:51.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.3 2024-04-26T00:50:51.631 DEBUG:teuthology.parallel:result is None 2024-04-26T00:50:51.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T00:50:51.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 Processor -- start 2024-04-26T00:50:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 -- start start 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f59a01412c0 0x7f59a00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a01417c0 con 0x7f59a00a2cb0 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0141a80 con 0x7f59a009fb30 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a834f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f59a0141d40 con 0x7f59a01412c0 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a68ec640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59a00a2cb0 0x7f59a014bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56986/0 (socket says 172.21.15.6:56986) 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a68ec640 1 -- 172.21.15.6:0/2815690000 learned_addr learned my addr 172.21.15.6:0/2815690000 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a58ea640 1 --2- 172.21.15.6:0/2815690000 >> v2:172.21.15.188:3300/0 conn(0x7f59a01412c0 0x7f59a00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809373329 0 0) 0x7f59a01417c0 con 0x7f59a00a2cb0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5988003530 con 0x7f59a00a2cb0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3340498657 0 0) 0x7f5988003530 con 0x7f59a00a2cb0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 >> v2:172.21.15.188:3300/0 conn(0x7f59a01412c0 msgr2=0x7f59a00a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 --2- 172.21.15.6:0/2815690000 >> v2:172.21.15.188:3300/0 conn(0x7f59a01412c0 0x7f59a00a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 >> v1:172.21.15.188:6789/0 conn(0x7f59a009fb30 legacy=0x7f59a00a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a009ff10 con 0x7f59a00a2cb0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f5998001680 con 0x7f59a00a2cb0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 >> v1:172.21.15.6:6789/0 conn(0x7f59a00a2cb0 legacy=0x7f59a014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 0x7f5988003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5988004810 0x7f5988004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59880052f0 0x7f598800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0141d40 con 0x7f5988003a10 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f598800c1f0 con 0x7f59880052f0 2024-04-26T00:50:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f598800c3f0 con 0x7f5988004810 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 0x7f5988003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a58ea640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5988004810 0x7f5988004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a68ec640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59880052f0 0x7f598800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 -- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5988004810 msgr2=0x7f5988004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5988004810 0x7f5988004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 -- 172.21.15.6:0/2815690000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59880052f0 msgr2=0x7f598800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59880052f0 0x7f598800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a60eb640 1 -- 172.21.15.6:0/2815690000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5988003530 con 0x7f5988003a10 2024-04-26T00:50:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.744+0000 7f59a68ec640 1 -- 172.21.15.6:0/2815690000 reap_dead start 2024-04-26T00:50:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 0x7f5988003e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5990001e70 tx=0x7f599001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aece40de12f7018 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990001a90 con 0x7f5988003a10 2024-04-26T00:50:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990003b80 con 0x7f5988003a10 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a50e9640 1 -- 172.21.15.6:0/2815690000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990005080 con 0x7f5988003a10 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 msgr2=0x7f5988003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 0x7f5988003e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5990001e70 tx=0x7f599001c740 comp rx=0 tx=0).stop 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- 172.21.15.6:0/2815690000 shutdown_connections 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 --2- 172.21.15.6:0/2815690000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5988003a10 0x7f5988003e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- 172.21.15.6:0/2815690000 >> 172.21.15.6:0/2815690000 conn(0x7f59a00b71a0 msgr2=0x7f59a00b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- 172.21.15.6:0/2815690000 shutdown_connections 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- 172.21.15.6:0/2815690000 wait complete. 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 Processor -- start 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- start start 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5988003a10 0x7f59a013dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59a00733f0 0x7f59a0137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00b3c30 con 0x7f59a0145250 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59a006bc00 con 0x7f5988003a10 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a834f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00b3db0 con 0x7f59a00733f0 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37564/0 (socket says 172.21.15.6:37564) 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 -- 172.21.15.6:0/2352095646 learned_addr learned my addr 172.21.15.6:0/2352095646 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a68ec640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59a00733f0 0x7f59a0137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5988003a10 0x7f59a013dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 -- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59a00733f0 msgr2=0x7f59a0137d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59a00733f0 0x7f59a0137d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 -- 172.21.15.6:0/2352095646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5988003a10 msgr2=0x7f59a013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5988003a10 0x7f59a013dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 -- 172.21.15.6:0/2352095646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0071a10 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.748+0000 7f59a58ea640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5994011900 tx=0x7f5994011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994019070 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5994004240 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a0070bf0 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940095b0 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a013e620 con 0x7f59a0145250 2024-04-26T00:50:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a006db70 con 0x7f59a0145250 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f599401c070 con 0x7f59a0145250 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 0x7f598c09b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 0x7f598c09b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f59940c2a20 con 0x7f59a0145250 2024-04-26T00:50:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.752+0000 7f59a60eb640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 0x7f598c09b780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5990005000 tx=0x7f5990001520 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.756+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f59940939b0 con 0x7f59a0145250 2024-04-26T00:50:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.908+0000 7f59a834f640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.908+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59a006be50 con 0x7f598c0992c0 2024-04-26T00:50:51.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.912+0000 7f599effd640 1 -- 172.21.15.6:0/2352095646 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268542 (secure 0 0 0) 0x7f59a006be50 con 0x7f598c0992c0 2024-04-26T00:50:51.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.912+0000 7f599effd640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:51.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 10 mgrc shutdown 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 msgr2=0x7f598c09b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 0x7f598c09b780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5990005000 tx=0x7f5990001520 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 msgr2=0x7f59a0070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5994011900 tx=0x7f5994011dc0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 shutdown_connections 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f598c0992c0 0x7f598c09b780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59a00733f0 0x7f59a0137d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0145250 0x7f59a0070380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 --2- 172.21.15.6:0/2352095646 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5988003a10 0x7f59a013dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 >> 172.21.15.6:0/2352095646 conn(0x7f59a00b71a0 msgr2=0x7f59a00a1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 shutdown_connections 2024-04-26T00:50:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:51.920+0000 7f59a834f640 1 -- 172.21.15.6:0/2352095646 wait complete. 2024-04-26T00:50:51.943 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-26T00:50:50.258073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114192,"kb_used_data":1944,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373168,"statfs":{"total":386547056640,"available":386430124032,"internally_reserved":0,"allocated":1990656,"data_stored":1439892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.015074"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855209+0000","last_change":"2024-04-26T00:50:39.864060+0000","last_active":"2024-04-26T00:50:40.855209+0000","last_peered":"2024-04-26T00:50:40.855209+0000","last_clean":"2024-04-26T00:50:40.855209+0000","last_became_active":"2024-04-26T00:50:39.863233+0000","last_became_peered":"2024-04-26T00:50:39.863233+0000","last_unstale":"2024-04-26T00:50:40.855209+0000","last_undegraded":"2024-04-26T00:50:40.855209+0000","last_fullsized":"2024-04-26T00:50:40.855209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.858910+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858358+0000","last_became_peered":"2024-04-26T00:50:39.858358+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.333493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.859022+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858634+0000","last_became_peered":"2024-04-26T00:50:39.858634+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:01:18.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464955+0000","last_change":"2024-04-26T00:50:39.861410+0000","last_active":"2024-04-26T00:50:41.464955+0000","last_peered":"2024-04-26T00:50:41.464955+0000","last_clean":"2024-04-26T00:50:41.464955+0000","last_became_active":"2024-04-26T00:50:39.860413+0000","last_became_peered":"2024-04-26T00:50:39.860413+0000","last_unstale":"2024-04-26T00:50:41.464955+0000","last_undegraded":"2024-04-26T00:50:41.464955+0000","last_fullsized":"2024-04-26T00:50:41.464955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465774+0000","last_change":"2024-04-26T00:50:39.854723+0000","last_active":"2024-04-26T00:50:41.465774+0000","last_peered":"2024-04-26T00:50:41.465774+0000","last_clean":"2024-04-26T00:50:41.465774+0000","last_became_active":"2024-04-26T00:50:39.854507+0000","last_became_peered":"2024-04-26T00:50:39.854507+0000","last_unstale":"2024-04-26T00:50:41.465774+0000","last_undegraded":"2024-04-26T00:50:41.465774+0000","last_fullsized":"2024-04-26T00:50:41.465774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:58.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465520+0000","last_change":"2024-04-26T00:50:39.848920+0000","last_active":"2024-04-26T00:50:41.465520+0000","last_peered":"2024-04-26T00:50:41.465520+0000","last_clean":"2024-04-26T00:50:41.465520+0000","last_became_active":"2024-04-26T00:50:39.848576+0000","last_became_peered":"2024-04-26T00:50:39.848576+0000","last_unstale":"2024-04-26T00:50:41.465520+0000","last_undegraded":"2024-04-26T00:50:41.465520+0000","last_fullsized":"2024-04-26T00:50:41.465520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:00.751396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465029+0000","last_change":"2024-04-26T00:50:39.848389+0000","last_active":"2024-04-26T00:50:41.465029+0000","last_peered":"2024-04-26T00:50:41.465029+0000","last_clean":"2024-04-26T00:50:41.465029+0000","last_became_active":"2024-04-26T00:50:39.847874+0000","last_became_peered":"2024-04-26T00:50:39.847874+0000","last_unstale":"2024-04-26T00:50:41.465029+0000","last_undegraded":"2024-04-26T00:50:41.465029+0000","last_fullsized":"2024-04-26T00:50:41.465029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:28.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849307+0000","last_change":"2024-04-26T00:50:39.863022+0000","last_active":"2024-04-26T00:50:40.849307+0000","last_peered":"2024-04-26T00:50:40.849307+0000","last_clean":"2024-04-26T00:50:40.849307+0000","last_became_active":"2024-04-26T00:50:39.862653+0000","last_became_peered":"2024-04-26T00:50:39.862653+0000","last_unstale":"2024-04-26T00:50:40.849307+0000","last_undegraded":"2024-04-26T00:50:40.849307+0000","last_fullsized":"2024-04-26T00:50:40.849307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855363+0000","last_change":"2024-04-26T00:50:39.864364+0000","last_active":"2024-04-26T00:50:40.855363+0000","last_peered":"2024-04-26T00:50:40.855363+0000","last_clean":"2024-04-26T00:50:40.855363+0000","last_became_active":"2024-04-26T00:50:39.863765+0000","last_became_peered":"2024-04-26T00:50:39.863765+0000","last_unstale":"2024-04-26T00:50:40.855363+0000","last_undegraded":"2024-04-26T00:50:40.855363+0000","last_fullsized":"2024-04-26T00:50:40.855363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:03.262591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468765+0000","last_change":"2024-04-26T00:50:39.860856+0000","last_active":"2024-04-26T00:50:41.468765+0000","last_peered":"2024-04-26T00:50:41.468765+0000","last_clean":"2024-04-26T00:50:41.468765+0000","last_became_active":"2024-04-26T00:50:39.860592+0000","last_became_peered":"2024-04-26T00:50:39.860592+0000","last_unstale":"2024-04-26T00:50:41.468765+0000","last_undegraded":"2024-04-26T00:50:41.468765+0000","last_fullsized":"2024-04-26T00:50:41.468765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468466+0000","last_change":"2024-04-26T00:50:39.854576+0000","last_active":"2024-04-26T00:50:41.468466+0000","last_peered":"2024-04-26T00:50:41.468466+0000","last_clean":"2024-04-26T00:50:41.468466+0000","last_became_active":"2024-04-26T00:50:39.854290+0000","last_became_peered":"2024-04-26T00:50:39.854290+0000","last_unstale":"2024-04-26T00:50:41.468466+0000","last_undegraded":"2024-04-26T00:50:41.468466+0000","last_fullsized":"2024-04-26T00:50:41.468466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855221+0000","last_change":"2024-04-26T00:50:39.867495+0000","last_active":"2024-04-26T00:50:40.855221+0000","last_peered":"2024-04-26T00:50:40.855221+0000","last_clean":"2024-04-26T00:50:40.855221+0000","last_became_active":"2024-04-26T00:50:39.866525+0000","last_became_peered":"2024-04-26T00:50:39.866525+0000","last_unstale":"2024-04-26T00:50:40.855221+0000","last_undegraded":"2024-04-26T00:50:40.855221+0000","last_fullsized":"2024-04-26T00:50:40.855221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854314+0000","last_change":"2024-04-26T00:50:39.866036+0000","last_active":"2024-04-26T00:50:40.854314+0000","last_peered":"2024-04-26T00:50:40.854314+0000","last_clean":"2024-04-26T00:50:40.854314+0000","last_became_active":"2024-04-26T00:50:39.864772+0000","last_became_peered":"2024-04-26T00:50:39.864772+0000","last_unstale":"2024-04-26T00:50:40.854314+0000","last_undegraded":"2024-04-26T00:50:40.854314+0000","last_fullsized":"2024-04-26T00:50:40.854314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:20.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850148+0000","last_change":"2024-04-26T00:50:39.850402+0000","last_active":"2024-04-26T00:50:40.850148+0000","last_peered":"2024-04-26T00:50:40.850148+0000","last_clean":"2024-04-26T00:50:40.850148+0000","last_became_active":"2024-04-26T00:50:39.849824+0000","last_became_peered":"2024-04-26T00:50:39.849824+0000","last_unstale":"2024-04-26T00:50:40.850148+0000","last_undegraded":"2024-04-26T00:50:40.850148+0000","last_fullsized":"2024-04-26T00:50:40.850148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849803+0000","last_change":"2024-04-26T00:50:39.859504+0000","last_active":"2024-04-26T00:50:40.849803+0000","last_peered":"2024-04-26T00:50:40.849803+0000","last_clean":"2024-04-26T00:50:40.849803+0000","last_became_active":"2024-04-26T00:50:39.858895+0000","last_became_peered":"2024-04-26T00:50:39.858895+0000","last_unstale":"2024-04-26T00:50:40.849803+0000","last_undegraded":"2024-04-26T00:50:40.849803+0000","last_fullsized":"2024-04-26T00:50:40.849803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849230+0000","last_change":"2024-04-26T00:50:39.862674+0000","last_active":"2024-04-26T00:50:40.849230+0000","last_peered":"2024-04-26T00:50:40.849230+0000","last_clean":"2024-04-26T00:50:40.849230+0000","last_became_active":"2024-04-26T00:50:39.862064+0000","last_became_peered":"2024-04-26T00:50:39.862064+0000","last_unstale":"2024-04-26T00:50:40.849230+0000","last_undegraded":"2024-04-26T00:50:40.849230+0000","last_fullsized":"2024-04-26T00:50:40.849230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469383+0000","last_change":"2024-04-26T00:50:39.868719+0000","last_active":"2024-04-26T00:50:41.469383+0000","last_peered":"2024-04-26T00:50:41.469383+0000","last_clean":"2024-04-26T00:50:41.469383+0000","last_became_active":"2024-04-26T00:50:39.868234+0000","last_became_peered":"2024-04-26T00:50:39.868234+0000","last_unstale":"2024-04-26T00:50:41.469383+0000","last_undegraded":"2024-04-26T00:50:41.469383+0000","last_fullsized":"2024-04-26T00:50:41.469383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467114+0000","last_change":"2024-04-26T00:50:39.864259+0000","last_active":"2024-04-26T00:50:41.467114+0000","last_peered":"2024-04-26T00:50:41.467114+0000","last_clean":"2024-04-26T00:50:41.467114+0000","last_became_active":"2024-04-26T00:50:39.863983+0000","last_became_peered":"2024-04-26T00:50:39.863983+0000","last_unstale":"2024-04-26T00:50:41.467114+0000","last_undegraded":"2024-04-26T00:50:41.467114+0000","last_fullsized":"2024-04-26T00:50:41.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854744+0000","last_change":"2024-04-26T00:50:39.865590+0000","last_active":"2024-04-26T00:50:40.854744+0000","last_peered":"2024-04-26T00:50:40.854744+0000","last_clean":"2024-04-26T00:50:40.854744+0000","last_became_active":"2024-04-26T00:50:39.865319+0000","last_became_peered":"2024-04-26T00:50:39.865319+0000","last_unstale":"2024-04-26T00:50:40.854744+0000","last_undegraded":"2024-04-26T00:50:40.854744+0000","last_fullsized":"2024-04-26T00:50:40.854744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:20.997241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467605+0000","last_change":"2024-04-26T00:50:39.856108+0000","last_active":"2024-04-26T00:50:41.467605+0000","last_peered":"2024-04-26T00:50:41.467605+0000","last_clean":"2024-04-26T00:50:41.467605+0000","last_became_active":"2024-04-26T00:50:39.855807+0000","last_became_peered":"2024-04-26T00:50:39.855807+0000","last_unstale":"2024-04-26T00:50:41.467605+0000","last_undegraded":"2024-04-26T00:50:41.467605+0000","last_fullsized":"2024-04-26T00:50:41.467605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850863+0000","last_change":"2024-04-26T00:50:39.843134+0000","last_active":"2024-04-26T00:50:40.850863+0000","last_peered":"2024-04-26T00:50:40.850863+0000","last_clean":"2024-04-26T00:50:40.850863+0000","last_became_active":"2024-04-26T00:50:39.842326+0000","last_became_peered":"2024-04-26T00:50:39.842326+0000","last_unstale":"2024-04-26T00:50:40.850863+0000","last_undegraded":"2024-04-26T00:50:40.850863+0000","last_fullsized":"2024-04-26T00:50:40.850863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:10:05.591117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464540+0000","last_change":"2024-04-26T00:50:39.854346+0000","last_active":"2024-04-26T00:50:41.464540+0000","last_peered":"2024-04-26T00:50:41.464540+0000","last_clean":"2024-04-26T00:50:41.464540+0000","last_became_active":"2024-04-26T00:50:39.854039+0000","last_became_peered":"2024-04-26T00:50:39.854039+0000","last_unstale":"2024-04-26T00:50:41.464540+0000","last_undegraded":"2024-04-26T00:50:41.464540+0000","last_fullsized":"2024-04-26T00:50:41.464540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465787+0000","last_change":"2024-04-26T00:50:39.860520+0000","last_active":"2024-04-26T00:50:41.465787+0000","last_peered":"2024-04-26T00:50:41.465787+0000","last_clean":"2024-04-26T00:50:41.465787+0000","last_became_active":"2024-04-26T00:50:39.859357+0000","last_became_peered":"2024-04-26T00:50:39.859357+0000","last_unstale":"2024-04-26T00:50:41.465787+0000","last_undegraded":"2024-04-26T00:50:41.465787+0000","last_fullsized":"2024-04-26T00:50:41.465787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849398+0000","last_change":"2024-04-26T00:50:39.858882+0000","last_active":"2024-04-26T00:50:40.849398+0000","last_peered":"2024-04-26T00:50:40.849398+0000","last_clean":"2024-04-26T00:50:40.849398+0000","last_became_active":"2024-04-26T00:50:39.858565+0000","last_became_peered":"2024-04-26T00:50:39.858565+0000","last_unstale":"2024-04-26T00:50:40.849398+0000","last_undegraded":"2024-04-26T00:50:40.849398+0000","last_fullsized":"2024-04-26T00:50:40.849398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468918+0000","last_change":"2024-04-26T00:50:39.857963+0000","last_active":"2024-04-26T00:50:41.468918+0000","last_peered":"2024-04-26T00:50:41.468918+0000","last_clean":"2024-04-26T00:50:41.468918+0000","last_became_active":"2024-04-26T00:50:39.857599+0000","last_became_peered":"2024-04-26T00:50:39.857599+0000","last_unstale":"2024-04-26T00:50:41.468918+0000","last_undegraded":"2024-04-26T00:50:41.468918+0000","last_fullsized":"2024-04-26T00:50:41.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469225+0000","last_change":"2024-04-26T00:50:39.863645+0000","last_active":"2024-04-26T00:50:41.469225+0000","last_peered":"2024-04-26T00:50:41.469225+0000","last_clean":"2024-04-26T00:50:41.469225+0000","last_became_active":"2024-04-26T00:50:39.863391+0000","last_became_peered":"2024-04-26T00:50:39.863391+0000","last_unstale":"2024-04-26T00:50:41.469225+0000","last_undegraded":"2024-04-26T00:50:41.469225+0000","last_fullsized":"2024-04-26T00:50:41.469225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852851+0000","last_change":"2024-04-26T00:50:39.860126+0000","last_active":"2024-04-26T00:50:40.852851+0000","last_peered":"2024-04-26T00:50:40.852851+0000","last_clean":"2024-04-26T00:50:40.852851+0000","last_became_active":"2024-04-26T00:50:39.859701+0000","last_became_peered":"2024-04-26T00:50:39.859701+0000","last_unstale":"2024-04-26T00:50:40.852851+0000","last_undegraded":"2024-04-26T00:50:40.852851+0000","last_fullsized":"2024-04-26T00:50:40.852851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:26:07.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468277+0000","last_change":"2024-04-26T00:50:39.868579+0000","last_active":"2024-04-26T00:50:41.468277+0000","last_peered":"2024-04-26T00:50:41.468277+0000","last_clean":"2024-04-26T00:50:41.468277+0000","last_became_active":"2024-04-26T00:50:39.868213+0000","last_became_peered":"2024-04-26T00:50:39.868213+0000","last_unstale":"2024-04-26T00:50:41.468277+0000","last_undegraded":"2024-04-26T00:50:41.468277+0000","last_fullsized":"2024-04-26T00:50:41.468277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465290+0000","last_change":"2024-04-26T00:50:39.855232+0000","last_active":"2024-04-26T00:50:41.465290+0000","last_peered":"2024-04-26T00:50:41.465290+0000","last_clean":"2024-04-26T00:50:41.465290+0000","last_became_active":"2024-04-26T00:50:39.852449+0000","last_became_peered":"2024-04-26T00:50:39.852449+0000","last_unstale":"2024-04-26T00:50:41.465290+0000","last_undegraded":"2024-04-26T00:50:41.465290+0000","last_fullsized":"2024-04-26T00:50:41.465290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:10.850384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465536+0000","last_change":"2024-04-26T00:50:39.852258+0000","last_active":"2024-04-26T00:50:41.465536+0000","last_peered":"2024-04-26T00:50:41.465536+0000","last_clean":"2024-04-26T00:50:41.465536+0000","last_became_active":"2024-04-26T00:50:39.851730+0000","last_became_peered":"2024-04-26T00:50:39.851730+0000","last_unstale":"2024-04-26T00:50:41.465536+0000","last_undegraded":"2024-04-26T00:50:41.465536+0000","last_fullsized":"2024-04-26T00:50:41.465536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465455+0000","last_change":"2024-04-26T00:50:39.848331+0000","last_active":"2024-04-26T00:50:41.465455+0000","last_peered":"2024-04-26T00:50:41.465455+0000","last_clean":"2024-04-26T00:50:41.465455+0000","last_became_active":"2024-04-26T00:50:39.848027+0000","last_became_peered":"2024-04-26T00:50:39.848027+0000","last_unstale":"2024-04-26T00:50:41.465455+0000","last_undegraded":"2024-04-26T00:50:41.465455+0000","last_fullsized":"2024-04-26T00:50:41.465455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:10.545861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849646+0000","last_change":"2024-04-26T00:50:39.862385+0000","last_active":"2024-04-26T00:50:40.849646+0000","last_peered":"2024-04-26T00:50:40.849646+0000","last_clean":"2024-04-26T00:50:40.849646+0000","last_became_active":"2024-04-26T00:50:39.861979+0000","last_became_peered":"2024-04-26T00:50:39.861979+0000","last_unstale":"2024-04-26T00:50:40.849646+0000","last_undegraded":"2024-04-26T00:50:40.849646+0000","last_fullsized":"2024-04-26T00:50:40.849646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465788+0000","last_change":"2024-04-26T00:50:39.857971+0000","last_active":"2024-04-26T00:50:41.465788+0000","last_peered":"2024-04-26T00:50:41.465788+0000","last_clean":"2024-04-26T00:50:41.465788+0000","last_became_active":"2024-04-26T00:50:39.857706+0000","last_became_peered":"2024-04-26T00:50:39.857706+0000","last_unstale":"2024-04-26T00:50:41.465788+0000","last_undegraded":"2024-04-26T00:50:41.465788+0000","last_fullsized":"2024-04-26T00:50:41.465788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466603+0000","last_change":"2024-04-26T00:50:38.870203+0000","last_active":"2024-04-26T00:50:41.466603+0000","last_peered":"2024-04-26T00:50:41.466603+0000","last_clean":"2024-04-26T00:50:41.466603+0000","last_became_active":"2024-04-26T00:50:38.869667+0000","last_became_peered":"2024-04-26T00:50:38.869667+0000","last_unstale":"2024-04-26T00:50:41.466603+0000","last_undegraded":"2024-04-26T00:50:41.466603+0000","last_fullsized":"2024-04-26T00:50:41.466603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.946855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466766+0000","last_change":"2024-04-26T00:50:39.851780+0000","last_active":"2024-04-26T00:50:41.466766+0000","last_peered":"2024-04-26T00:50:41.466766+0000","last_clean":"2024-04-26T00:50:41.466766+0000","last_became_active":"2024-04-26T00:50:39.851487+0000","last_became_peered":"2024-04-26T00:50:39.851487+0000","last_unstale":"2024-04-26T00:50:41.466766+0000","last_undegraded":"2024-04-26T00:50:41.466766+0000","last_fullsized":"2024-04-26T00:50:41.466766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854350+0000","last_change":"2024-04-26T00:50:38.858405+0000","last_active":"2024-04-26T00:50:40.854350+0000","last_peered":"2024-04-26T00:50:40.854350+0000","last_clean":"2024-04-26T00:50:40.854350+0000","last_became_active":"2024-04-26T00:50:38.857294+0000","last_became_peered":"2024-04-26T00:50:38.857294+0000","last_unstale":"2024-04-26T00:50:40.854350+0000","last_undegraded":"2024-04-26T00:50:40.854350+0000","last_fullsized":"2024-04-26T00:50:40.854350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.943770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466331+0000","last_change":"2024-04-26T00:50:39.854371+0000","last_active":"2024-04-26T00:50:41.466331+0000","last_peered":"2024-04-26T00:50:41.466331+0000","last_clean":"2024-04-26T00:50:41.466331+0000","last_became_active":"2024-04-26T00:50:39.851258+0000","last_became_peered":"2024-04-26T00:50:39.851258+0000","last_unstale":"2024-04-26T00:50:41.466331+0000","last_undegraded":"2024-04-26T00:50:41.466331+0000","last_fullsized":"2024-04-26T00:50:41.466331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850071+0000","last_change":"2024-04-26T00:50:38.855662+0000","last_active":"2024-04-26T00:50:40.850071+0000","last_peered":"2024-04-26T00:50:40.850071+0000","last_clean":"2024-04-26T00:50:40.850071+0000","last_became_active":"2024-04-26T00:50:38.855264+0000","last_became_peered":"2024-04-26T00:50:38.855264+0000","last_unstale":"2024-04-26T00:50:40.850071+0000","last_undegraded":"2024-04-26T00:50:40.850071+0000","last_fullsized":"2024-04-26T00:50:40.850071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:54.888616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468580+0000","last_change":"2024-04-26T00:50:39.860246+0000","last_active":"2024-04-26T00:50:41.468580+0000","last_peered":"2024-04-26T00:50:41.468580+0000","last_clean":"2024-04-26T00:50:41.468580+0000","last_became_active":"2024-04-26T00:50:39.859961+0000","last_became_peered":"2024-04-26T00:50:39.859961+0000","last_unstale":"2024-04-26T00:50:41.468580+0000","last_undegraded":"2024-04-26T00:50:41.468580+0000","last_fullsized":"2024-04-26T00:50:41.468580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849532+0000","last_change":"2024-04-26T00:50:38.858626+0000","last_active":"2024-04-26T00:50:40.849532+0000","last_peered":"2024-04-26T00:50:40.849532+0000","last_clean":"2024-04-26T00:50:40.849532+0000","last_became_active":"2024-04-26T00:50:38.858137+0000","last_became_peered":"2024-04-26T00:50:38.858137+0000","last_unstale":"2024-04-26T00:50:40.849532+0000","last_undegraded":"2024-04-26T00:50:40.849532+0000","last_fullsized":"2024-04-26T00:50:40.849532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:38.523333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852229+0000","last_change":"2024-04-26T00:50:38.873856+0000","last_active":"2024-04-26T00:50:40.852229+0000","last_peered":"2024-04-26T00:50:40.852229+0000","last_clean":"2024-04-26T00:50:40.852229+0000","last_became_active":"2024-04-26T00:50:38.873335+0000","last_became_peered":"2024-04-26T00:50:38.873335+0000","last_unstale":"2024-04-26T00:50:40.852229+0000","last_undegraded":"2024-04-26T00:50:40.852229+0000","last_fullsized":"2024-04-26T00:50:40.852229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:50.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465911+0000","last_change":"2024-04-26T00:50:39.848253+0000","last_active":"2024-04-26T00:50:41.465911+0000","last_peered":"2024-04-26T00:50:41.465911+0000","last_clean":"2024-04-26T00:50:41.465911+0000","last_became_active":"2024-04-26T00:50:39.847884+0000","last_became_peered":"2024-04-26T00:50:39.847884+0000","last_unstale":"2024-04-26T00:50:41.465911+0000","last_undegraded":"2024-04-26T00:50:41.465911+0000","last_fullsized":"2024-04-26T00:50:41.465911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851684+0000","last_change":"2024-04-26T00:50:38.845913+0000","last_active":"2024-04-26T00:50:40.851684+0000","last_peered":"2024-04-26T00:50:40.851684+0000","last_clean":"2024-04-26T00:50:40.851684+0000","last_became_active":"2024-04-26T00:50:38.845248+0000","last_became_peered":"2024-04-26T00:50:38.845248+0000","last_unstale":"2024-04-26T00:50:40.851684+0000","last_undegraded":"2024-04-26T00:50:40.851684+0000","last_fullsized":"2024-04-26T00:50:40.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:01:14.839151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465102+0000","last_change":"2024-04-26T00:50:39.862106+0000","last_active":"2024-04-26T00:50:41.465102+0000","last_peered":"2024-04-26T00:50:41.465102+0000","last_clean":"2024-04-26T00:50:41.465102+0000","last_became_active":"2024-04-26T00:50:39.861838+0000","last_became_peered":"2024-04-26T00:50:39.861838+0000","last_unstale":"2024-04-26T00:50:41.465102+0000","last_undegraded":"2024-04-26T00:50:41.465102+0000","last_fullsized":"2024-04-26T00:50:41.465102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852430+0000","last_change":"2024-04-26T00:50:38.869341+0000","last_active":"2024-04-26T00:50:40.852430+0000","last_peered":"2024-04-26T00:50:40.852430+0000","last_clean":"2024-04-26T00:50:40.852430+0000","last_became_active":"2024-04-26T00:50:38.868538+0000","last_became_peered":"2024-04-26T00:50:38.868538+0000","last_unstale":"2024-04-26T00:50:40.852430+0000","last_undegraded":"2024-04-26T00:50:40.852430+0000","last_fullsized":"2024-04-26T00:50:40.852430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:09.233129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850440+0000","last_change":"2024-04-26T00:50:39.838874+0000","last_active":"2024-04-26T00:50:40.850440+0000","last_peered":"2024-04-26T00:50:40.850440+0000","last_clean":"2024-04-26T00:50:40.850440+0000","last_became_active":"2024-04-26T00:50:39.838130+0000","last_became_peered":"2024-04-26T00:50:39.838130+0000","last_unstale":"2024-04-26T00:50:40.850440+0000","last_undegraded":"2024-04-26T00:50:40.850440+0000","last_fullsized":"2024-04-26T00:50:40.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851387+0000","last_change":"2024-04-26T00:50:38.852912+0000","last_active":"2024-04-26T00:50:40.851387+0000","last_peered":"2024-04-26T00:50:40.851387+0000","last_clean":"2024-04-26T00:50:40.851387+0000","last_became_active":"2024-04-26T00:50:38.852425+0000","last_became_peered":"2024-04-26T00:50:38.852425+0000","last_unstale":"2024-04-26T00:50:40.851387+0000","last_undegraded":"2024-04-26T00:50:40.851387+0000","last_fullsized":"2024-04-26T00:50:40.851387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:26.487714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854707+0000","last_change":"2024-04-26T00:50:39.858386+0000","last_active":"2024-04-26T00:50:40.854707+0000","last_peered":"2024-04-26T00:50:40.854707+0000","last_clean":"2024-04-26T00:50:40.854707+0000","last_became_active":"2024-04-26T00:50:39.858084+0000","last_became_peered":"2024-04-26T00:50:39.858084+0000","last_unstale":"2024-04-26T00:50:40.854707+0000","last_undegraded":"2024-04-26T00:50:40.854707+0000","last_fullsized":"2024-04-26T00:50:40.854707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:24.695303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466946+0000","last_change":"2024-04-26T00:50:38.876499+0000","last_active":"2024-04-26T00:50:41.466946+0000","last_peered":"2024-04-26T00:50:41.466946+0000","last_clean":"2024-04-26T00:50:41.466946+0000","last_became_active":"2024-04-26T00:50:38.875568+0000","last_became_peered":"2024-04-26T00:50:38.875568+0000","last_unstale":"2024-04-26T00:50:41.466946+0000","last_undegraded":"2024-04-26T00:50:41.466946+0000","last_fullsized":"2024-04-26T00:50:41.466946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:08.851681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467684+0000","last_change":"2024-04-26T00:50:39.861634+0000","last_active":"2024-04-26T00:50:41.467684+0000","last_peered":"2024-04-26T00:50:41.467684+0000","last_clean":"2024-04-26T00:50:41.467684+0000","last_became_active":"2024-04-26T00:50:39.860919+0000","last_became_peered":"2024-04-26T00:50:39.860919+0000","last_unstale":"2024-04-26T00:50:41.467684+0000","last_undegraded":"2024-04-26T00:50:41.467684+0000","last_fullsized":"2024-04-26T00:50:41.467684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:38.858272+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:38.857911+0000","last_became_peered":"2024-04-26T00:50:38.857911+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:02.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851832+0000","last_change":"2024-04-26T00:50:39.855731+0000","last_active":"2024-04-26T00:50:40.851832+0000","last_peered":"2024-04-26T00:50:40.851832+0000","last_clean":"2024-04-26T00:50:40.851832+0000","last_became_active":"2024-04-26T00:50:39.855401+0000","last_became_peered":"2024-04-26T00:50:39.855401+0000","last_unstale":"2024-04-26T00:50:40.851832+0000","last_undegraded":"2024-04-26T00:50:40.851832+0000","last_fullsized":"2024-04-26T00:50:40.851832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:05.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466079+0000","last_change":"2024-04-26T00:50:38.876014+0000","last_active":"2024-04-26T00:50:41.466079+0000","last_peered":"2024-04-26T00:50:41.466079+0000","last_clean":"2024-04-26T00:50:41.466079+0000","last_became_active":"2024-04-26T00:50:38.875346+0000","last_became_peered":"2024-04-26T00:50:38.875346+0000","last_unstale":"2024-04-26T00:50:41.466079+0000","last_undegraded":"2024-04-26T00:50:41.466079+0000","last_fullsized":"2024-04-26T00:50:41.466079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:25.084153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855287+0000","last_change":"2024-04-26T00:50:39.852334+0000","last_active":"2024-04-26T00:50:40.855287+0000","last_peered":"2024-04-26T00:50:40.855287+0000","last_clean":"2024-04-26T00:50:40.855287+0000","last_became_active":"2024-04-26T00:50:39.849126+0000","last_became_peered":"2024-04-26T00:50:39.849126+0000","last_unstale":"2024-04-26T00:50:40.855287+0000","last_undegraded":"2024-04-26T00:50:40.855287+0000","last_fullsized":"2024-04-26T00:50:40.855287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:55.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464952+0000","last_change":"2024-04-26T00:50:38.879815+0000","last_active":"2024-04-26T00:50:41.464952+0000","last_peered":"2024-04-26T00:50:41.464952+0000","last_clean":"2024-04-26T00:50:41.464952+0000","last_became_active":"2024-04-26T00:50:38.876392+0000","last_became_peered":"2024-04-26T00:50:38.876392+0000","last_unstale":"2024-04-26T00:50:41.464952+0000","last_undegraded":"2024-04-26T00:50:41.464952+0000","last_fullsized":"2024-04-26T00:50:41.464952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:07.680535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469056+0000","last_change":"2024-04-26T00:50:39.862953+0000","last_active":"2024-04-26T00:50:41.469056+0000","last_peered":"2024-04-26T00:50:41.469056+0000","last_clean":"2024-04-26T00:50:41.469056+0000","last_became_active":"2024-04-26T00:50:39.862133+0000","last_became_peered":"2024-04-26T00:50:39.862133+0000","last_unstale":"2024-04-26T00:50:41.469056+0000","last_undegraded":"2024-04-26T00:50:41.469056+0000","last_fullsized":"2024-04-26T00:50:41.469056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464665+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:41.464665+0000","last_peered":"2024-04-26T00:50:41.464665+0000","last_clean":"2024-04-26T00:50:41.464665+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:41.464665+0000","last_undegraded":"2024-04-26T00:50:41.464665+0000","last_fullsized":"2024-04-26T00:50:41.464665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851020+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:40.851020+0000","last_peered":"2024-04-26T00:50:40.851020+0000","last_clean":"2024-04-26T00:50:40.851020+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:40.851020+0000","last_undegraded":"2024-04-26T00:50:40.851020+0000","last_fullsized":"2024-04-26T00:50:40.851020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467042+0000","last_change":"2024-04-26T00:50:38.866703+0000","last_active":"2024-04-26T00:50:41.467042+0000","last_peered":"2024-04-26T00:50:41.467042+0000","last_clean":"2024-04-26T00:50:41.467042+0000","last_became_active":"2024-04-26T00:50:38.866123+0000","last_became_peered":"2024-04-26T00:50:38.866123+0000","last_unstale":"2024-04-26T00:50:41.467042+0000","last_undegraded":"2024-04-26T00:50:41.467042+0000","last_fullsized":"2024-04-26T00:50:41.467042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:09.927849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852406+0000","last_change":"2024-04-26T00:50:39.859004+0000","last_active":"2024-04-26T00:50:40.852406+0000","last_peered":"2024-04-26T00:50:40.852406+0000","last_clean":"2024-04-26T00:50:40.852406+0000","last_became_active":"2024-04-26T00:50:39.858536+0000","last_became_peered":"2024-04-26T00:50:39.858536+0000","last_unstale":"2024-04-26T00:50:40.852406+0000","last_undegraded":"2024-04-26T00:50:40.852406+0000","last_fullsized":"2024-04-26T00:50:40.852406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:44.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849761+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:40.849761+0000","last_peered":"2024-04-26T00:50:40.849761+0000","last_clean":"2024-04-26T00:50:40.849761+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:40.849761+0000","last_undegraded":"2024-04-26T00:50:40.849761+0000","last_fullsized":"2024-04-26T00:50:40.849761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465609+0000","last_change":"2024-04-26T00:50:38.862050+0000","last_active":"2024-04-26T00:50:41.465609+0000","last_peered":"2024-04-26T00:50:41.465609+0000","last_clean":"2024-04-26T00:50:41.465609+0000","last_became_active":"2024-04-26T00:50:38.861329+0000","last_became_peered":"2024-04-26T00:50:38.861329+0000","last_unstale":"2024-04-26T00:50:41.465609+0000","last_undegraded":"2024-04-26T00:50:41.465609+0000","last_fullsized":"2024-04-26T00:50:41.465609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:19.670169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466871+0000","last_change":"2024-04-26T00:50:39.859556+0000","last_active":"2024-04-26T00:50:41.466871+0000","last_peered":"2024-04-26T00:50:41.466871+0000","last_clean":"2024-04-26T00:50:41.466871+0000","last_became_active":"2024-04-26T00:50:39.858347+0000","last_became_peered":"2024-04-26T00:50:39.858347+0000","last_unstale":"2024-04-26T00:50:41.466871+0000","last_undegraded":"2024-04-26T00:50:41.466871+0000","last_fullsized":"2024-04-26T00:50:41.466871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854116+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:40.854116+0000","last_peered":"2024-04-26T00:50:40.854116+0000","last_clean":"2024-04-26T00:50:40.854116+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:40.854116+0000","last_undegraded":"2024-04-26T00:50:40.854116+0000","last_fullsized":"2024-04-26T00:50:40.854116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464225+0000","last_change":"2024-04-26T00:50:38.864670+0000","last_active":"2024-04-26T00:50:41.464225+0000","last_peered":"2024-04-26T00:50:41.464225+0000","last_clean":"2024-04-26T00:50:41.464225+0000","last_became_active":"2024-04-26T00:50:38.861543+0000","last_became_peered":"2024-04-26T00:50:38.861543+0000","last_unstale":"2024-04-26T00:50:41.464225+0000","last_undegraded":"2024-04-26T00:50:41.464225+0000","last_fullsized":"2024-04-26T00:50:41.464225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469153+0000","last_change":"2024-04-26T00:50:39.862379+0000","last_active":"2024-04-26T00:50:41.469153+0000","last_peered":"2024-04-26T00:50:41.469153+0000","last_clean":"2024-04-26T00:50:41.469153+0000","last_became_active":"2024-04-26T00:50:39.860598+0000","last_became_peered":"2024-04-26T00:50:39.860598+0000","last_unstale":"2024-04-26T00:50:41.469153+0000","last_undegraded":"2024-04-26T00:50:41.469153+0000","last_fullsized":"2024-04-26T00:50:41.469153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850966+0000","last_change":"2024-04-26T00:50:38.857970+0000","last_active":"2024-04-26T00:50:40.850966+0000","last_peered":"2024-04-26T00:50:40.850966+0000","last_clean":"2024-04-26T00:50:40.850966+0000","last_became_active":"2024-04-26T00:50:38.857664+0000","last_became_peered":"2024-04-26T00:50:38.857664+0000","last_unstale":"2024-04-26T00:50:40.850966+0000","last_undegraded":"2024-04-26T00:50:40.850966+0000","last_fullsized":"2024-04-26T00:50:40.850966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.406470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467834+0000","last_change":"2024-04-26T00:50:39.868652+0000","last_active":"2024-04-26T00:50:41.467834+0000","last_peered":"2024-04-26T00:50:41.467834+0000","last_clean":"2024-04-26T00:50:41.467834+0000","last_became_active":"2024-04-26T00:50:39.868244+0000","last_became_peered":"2024-04-26T00:50:39.868244+0000","last_unstale":"2024-04-26T00:50:41.467834+0000","last_undegraded":"2024-04-26T00:50:41.467834+0000","last_fullsized":"2024-04-26T00:50:41.467834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852702+0000","last_change":"2024-04-26T00:50:38.868988+0000","last_active":"2024-04-26T00:50:40.852702+0000","last_peered":"2024-04-26T00:50:40.852702+0000","last_clean":"2024-04-26T00:50:40.852702+0000","last_became_active":"2024-04-26T00:50:38.868419+0000","last_became_peered":"2024-04-26T00:50:38.868419+0000","last_unstale":"2024-04-26T00:50:40.852702+0000","last_undegraded":"2024-04-26T00:50:40.852702+0000","last_fullsized":"2024-04-26T00:50:40.852702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.246593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468295+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:41.468295+0000","last_peered":"2024-04-26T00:50:41.468295+0000","last_clean":"2024-04-26T00:50:41.468295+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:41.468295+0000","last_undegraded":"2024-04-26T00:50:41.468295+0000","last_fullsized":"2024-04-26T00:50:41.468295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464953+0000","last_change":"2024-04-26T00:50:39.855312+0000","last_active":"2024-04-26T00:50:41.464953+0000","last_peered":"2024-04-26T00:50:41.464953+0000","last_clean":"2024-04-26T00:50:41.464953+0000","last_became_active":"2024-04-26T00:50:39.853775+0000","last_became_peered":"2024-04-26T00:50:39.853775+0000","last_unstale":"2024-04-26T00:50:41.464953+0000","last_undegraded":"2024-04-26T00:50:41.464953+0000","last_fullsized":"2024-04-26T00:50:41.464953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468158+0000","last_change":"2024-04-26T00:50:38.863255+0000","last_active":"2024-04-26T00:50:41.468158+0000","last_peered":"2024-04-26T00:50:41.468158+0000","last_clean":"2024-04-26T00:50:41.468158+0000","last_became_active":"2024-04-26T00:50:38.861925+0000","last_became_peered":"2024-04-26T00:50:38.861925+0000","last_unstale":"2024-04-26T00:50:41.468158+0000","last_undegraded":"2024-04-26T00:50:41.468158+0000","last_fullsized":"2024-04-26T00:50:41.468158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:37.293965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852840+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:40.852840+0000","last_peered":"2024-04-26T00:50:40.852840+0000","last_clean":"2024-04-26T00:50:40.852840+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:40.852840+0000","last_undegraded":"2024-04-26T00:50:40.852840+0000","last_fullsized":"2024-04-26T00:50:40.852840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467285+0000","last_change":"2024-04-26T00:50:39.859688+0000","last_active":"2024-04-26T00:50:41.467285+0000","last_peered":"2024-04-26T00:50:41.467285+0000","last_clean":"2024-04-26T00:50:41.467285+0000","last_became_active":"2024-04-26T00:50:39.859353+0000","last_became_peered":"2024-04-26T00:50:39.859353+0000","last_unstale":"2024-04-26T00:50:41.467285+0000","last_undegraded":"2024-04-26T00:50:41.467285+0000","last_fullsized":"2024-04-26T00:50:41.467285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468552+0000","last_change":"2024-04-26T00:50:38.876486+0000","last_active":"2024-04-26T00:50:41.468552+0000","last_peered":"2024-04-26T00:50:41.468552+0000","last_clean":"2024-04-26T00:50:41.468552+0000","last_became_active":"2024-04-26T00:50:38.875909+0000","last_became_peered":"2024-04-26T00:50:38.875909+0000","last_unstale":"2024-04-26T00:50:41.468552+0000","last_undegraded":"2024-04-26T00:50:41.468552+0000","last_fullsized":"2024-04-26T00:50:41.468552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:40:21.077132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469439+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:41.469439+0000","last_peered":"2024-04-26T00:50:41.469439+0000","last_clean":"2024-04-26T00:50:41.469439+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:41.469439+0000","last_undegraded":"2024-04-26T00:50:41.469439+0000","last_fullsized":"2024-04-26T00:50:41.469439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464450+0000","last_change":"2024-04-26T00:50:39.848704+0000","last_active":"2024-04-26T00:50:41.464450+0000","last_peered":"2024-04-26T00:50:41.464450+0000","last_clean":"2024-04-26T00:50:41.464450+0000","last_became_active":"2024-04-26T00:50:39.848429+0000","last_became_peered":"2024-04-26T00:50:39.848429+0000","last_unstale":"2024-04-26T00:50:41.464450+0000","last_undegraded":"2024-04-26T00:50:41.464450+0000","last_fullsized":"2024-04-26T00:50:41.464450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:40.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.837302+0000","last_change":"2024-04-26T00:50:38.867565+0000","last_active":"2024-04-26T00:50:41.837302+0000","last_peered":"2024-04-26T00:50:41.837302+0000","last_clean":"2024-04-26T00:50:41.837302+0000","last_became_active":"2024-04-26T00:50:38.866728+0000","last_became_peered":"2024-04-26T00:50:38.866728+0000","last_unstale":"2024-04-26T00:50:41.837302+0000","last_undegraded":"2024-04-26T00:50:41.837302+0000","last_fullsized":"2024-04-26T00:50:41.837302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:23.691727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852376+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:40.852376+0000","last_peered":"2024-04-26T00:50:40.852376+0000","last_clean":"2024-04-26T00:50:40.852376+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:40.852376+0000","last_undegraded":"2024-04-26T00:50:40.852376+0000","last_fullsized":"2024-04-26T00:50:40.852376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854095+0000","last_change":"2024-04-26T00:50:39.856903+0000","last_active":"2024-04-26T00:50:40.854095+0000","last_peered":"2024-04-26T00:50:40.854095+0000","last_clean":"2024-04-26T00:50:40.854095+0000","last_became_active":"2024-04-26T00:50:39.856609+0000","last_became_peered":"2024-04-26T00:50:39.856609+0000","last_unstale":"2024-04-26T00:50:40.854095+0000","last_undegraded":"2024-04-26T00:50:40.854095+0000","last_fullsized":"2024-04-26T00:50:40.854095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:12.129353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854504+0000","last_change":"2024-04-26T00:50:39.857946+0000","last_active":"2024-04-26T00:50:40.854504+0000","last_peered":"2024-04-26T00:50:40.854504+0000","last_clean":"2024-04-26T00:50:40.854504+0000","last_became_active":"2024-04-26T00:50:39.857653+0000","last_became_peered":"2024-04-26T00:50:39.857653+0000","last_unstale":"2024-04-26T00:50:40.854504+0000","last_undegraded":"2024-04-26T00:50:40.854504+0000","last_fullsized":"2024-04-26T00:50:40.854504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:40.181948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851322+0000","last_change":"2024-04-26T00:50:38.846157+0000","last_active":"2024-04-26T00:50:40.851322+0000","last_peered":"2024-04-26T00:50:40.851322+0000","last_clean":"2024-04-26T00:50:40.851322+0000","last_became_active":"2024-04-26T00:50:38.845728+0000","last_became_peered":"2024-04-26T00:50:38.845728+0000","last_unstale":"2024-04-26T00:50:40.851322+0000","last_undegraded":"2024-04-26T00:50:40.851322+0000","last_fullsized":"2024-04-26T00:50:40.851322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465860+0000","last_change":"2024-04-26T00:50:39.851993+0000","last_active":"2024-04-26T00:50:41.465860+0000","last_peered":"2024-04-26T00:50:41.465860+0000","last_clean":"2024-04-26T00:50:41.465860+0000","last_became_active":"2024-04-26T00:50:39.851385+0000","last_became_peered":"2024-04-26T00:50:39.851385+0000","last_unstale":"2024-04-26T00:50:41.465860+0000","last_undegraded":"2024-04-26T00:50:41.465860+0000","last_fullsized":"2024-04-26T00:50:41.465860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855046+0000","last_change":"2024-04-26T00:50:38.859885+0000","last_active":"2024-04-26T00:50:40.855046+0000","last_peered":"2024-04-26T00:50:40.855046+0000","last_clean":"2024-04-26T00:50:40.855046+0000","last_became_active":"2024-04-26T00:50:38.858568+0000","last_became_peered":"2024-04-26T00:50:38.858568+0000","last_unstale":"2024-04-26T00:50:40.855046+0000","last_undegraded":"2024-04-26T00:50:40.855046+0000","last_fullsized":"2024-04-26T00:50:40.855046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851422+0000","last_change":"2024-04-26T00:50:38.866142+0000","last_active":"2024-04-26T00:50:40.851422+0000","last_peered":"2024-04-26T00:50:40.851422+0000","last_clean":"2024-04-26T00:50:40.851422+0000","last_became_active":"2024-04-26T00:50:38.865557+0000","last_became_peered":"2024-04-26T00:50:38.865557+0000","last_unstale":"2024-04-26T00:50:40.851422+0000","last_undegraded":"2024-04-26T00:50:40.851422+0000","last_fullsized":"2024-04-26T00:50:40.851422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:31.035091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466248+0000","last_change":"2024-04-26T00:50:39.854303+0000","last_active":"2024-04-26T00:50:41.466248+0000","last_peered":"2024-04-26T00:50:41.466248+0000","last_clean":"2024-04-26T00:50:41.466248+0000","last_became_active":"2024-04-26T00:50:39.852216+0000","last_became_peered":"2024-04-26T00:50:39.852216+0000","last_unstale":"2024-04-26T00:50:41.466248+0000","last_undegraded":"2024-04-26T00:50:41.466248+0000","last_fullsized":"2024-04-26T00:50:41.466248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469542+0000","last_change":"2024-04-26T00:50:38.867859+0000","last_active":"2024-04-26T00:50:41.469542+0000","last_peered":"2024-04-26T00:50:41.469542+0000","last_clean":"2024-04-26T00:50:41.469542+0000","last_became_active":"2024-04-26T00:50:38.866771+0000","last_became_peered":"2024-04-26T00:50:38.866771+0000","last_unstale":"2024-04-26T00:50:41.469542+0000","last_undegraded":"2024-04-26T00:50:41.469542+0000","last_fullsized":"2024-04-26T00:50:41.469542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464008+0000","last_change":"2024-04-26T00:50:39.851991+0000","last_active":"2024-04-26T00:50:41.464008+0000","last_peered":"2024-04-26T00:50:41.464008+0000","last_clean":"2024-04-26T00:50:41.464008+0000","last_became_active":"2024-04-26T00:50:39.851680+0000","last_became_peered":"2024-04-26T00:50:39.851680+0000","last_unstale":"2024-04-26T00:50:41.464008+0000","last_undegraded":"2024-04-26T00:50:41.464008+0000","last_fullsized":"2024-04-26T00:50:41.464008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:51.385973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852269+0000","last_change":"2024-04-26T00:50:39.859275+0000","last_active":"2024-04-26T00:50:40.852269+0000","last_peered":"2024-04-26T00:50:40.852269+0000","last_clean":"2024-04-26T00:50:40.852269+0000","last_became_active":"2024-04-26T00:50:39.858722+0000","last_became_peered":"2024-04-26T00:50:39.858722+0000","last_unstale":"2024-04-26T00:50:40.852269+0000","last_undegraded":"2024-04-26T00:50:40.852269+0000","last_fullsized":"2024-04-26T00:50:40.852269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:43.277704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464709+0000","last_change":"2024-04-26T00:50:38.876692+0000","last_active":"2024-04-26T00:50:41.464709+0000","last_peered":"2024-04-26T00:50:41.464709+0000","last_clean":"2024-04-26T00:50:41.464709+0000","last_became_active":"2024-04-26T00:50:38.875789+0000","last_became_peered":"2024-04-26T00:50:38.875789+0000","last_unstale":"2024-04-26T00:50:41.464709+0000","last_undegraded":"2024-04-26T00:50:41.464709+0000","last_fullsized":"2024-04-26T00:50:41.464709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468966+0000","last_change":"2024-04-26T00:50:39.853149+0000","last_active":"2024-04-26T00:50:41.468966+0000","last_peered":"2024-04-26T00:50:41.468966+0000","last_clean":"2024-04-26T00:50:41.468966+0000","last_became_active":"2024-04-26T00:50:39.852980+0000","last_became_peered":"2024-04-26T00:50:39.852980+0000","last_unstale":"2024-04-26T00:50:41.468966+0000","last_undegraded":"2024-04-26T00:50:41.468966+0000","last_fullsized":"2024-04-26T00:50:41.468966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465368+0000","last_change":"2024-04-26T00:50:38.868567+0000","last_active":"2024-04-26T00:50:41.465368+0000","last_peered":"2024-04-26T00:50:41.465368+0000","last_clean":"2024-04-26T00:50:41.465368+0000","last_became_active":"2024-04-26T00:50:38.867948+0000","last_became_peered":"2024-04-26T00:50:38.867948+0000","last_unstale":"2024-04-26T00:50:41.465368+0000","last_undegraded":"2024-04-26T00:50:41.465368+0000","last_fullsized":"2024-04-26T00:50:41.465368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:11.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466691+0000","last_change":"2024-04-26T00:50:39.860208+0000","last_active":"2024-04-26T00:50:41.466691+0000","last_peered":"2024-04-26T00:50:41.466691+0000","last_clean":"2024-04-26T00:50:41.466691+0000","last_became_active":"2024-04-26T00:50:39.859876+0000","last_became_peered":"2024-04-26T00:50:39.859876+0000","last_unstale":"2024-04-26T00:50:41.466691+0000","last_undegraded":"2024-04-26T00:50:41.466691+0000","last_fullsized":"2024-04-26T00:50:41.466691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850749+0000","last_change":"2024-04-26T00:50:38.866484+0000","last_active":"2024-04-26T00:50:40.850749+0000","last_peered":"2024-04-26T00:50:40.850749+0000","last_clean":"2024-04-26T00:50:40.850749+0000","last_became_active":"2024-04-26T00:50:38.865840+0000","last_became_peered":"2024-04-26T00:50:38.865840+0000","last_unstale":"2024-04-26T00:50:40.850749+0000","last_undegraded":"2024-04-26T00:50:40.850749+0000","last_fullsized":"2024-04-26T00:50:40.850749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:37.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855141+0000","last_change":"2024-04-26T00:50:39.866945+0000","last_active":"2024-04-26T00:50:40.855141+0000","last_peered":"2024-04-26T00:50:40.855141+0000","last_clean":"2024-04-26T00:50:40.855141+0000","last_became_active":"2024-04-26T00:50:39.866257+0000","last_became_peered":"2024-04-26T00:50:39.866257+0000","last_unstale":"2024-04-26T00:50:40.855141+0000","last_undegraded":"2024-04-26T00:50:40.855141+0000","last_fullsized":"2024-04-26T00:50:40.855141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:07.845148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466077+0000","last_change":"2024-04-26T00:50:38.870006+0000","last_active":"2024-04-26T00:50:41.466077+0000","last_peered":"2024-04-26T00:50:41.466077+0000","last_clean":"2024-04-26T00:50:41.466077+0000","last_became_active":"2024-04-26T00:50:38.869408+0000","last_became_peered":"2024-04-26T00:50:38.869408+0000","last_unstale":"2024-04-26T00:50:41.466077+0000","last_undegraded":"2024-04-26T00:50:41.466077+0000","last_fullsized":"2024-04-26T00:50:41.466077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:20.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854580+0000","last_change":"2024-04-26T00:50:39.867012+0000","last_active":"2024-04-26T00:50:40.854580+0000","last_peered":"2024-04-26T00:50:40.854580+0000","last_clean":"2024-04-26T00:50:40.854580+0000","last_became_active":"2024-04-26T00:50:39.866002+0000","last_became_peered":"2024-04-26T00:50:39.866002+0000","last_unstale":"2024-04-26T00:50:40.854580+0000","last_undegraded":"2024-04-26T00:50:40.854580+0000","last_fullsized":"2024-04-26T00:50:40.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:38.297542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467910+0000","last_change":"2024-04-26T00:50:38.868711+0000","last_active":"2024-04-26T00:50:41.467910+0000","last_peered":"2024-04-26T00:50:41.467910+0000","last_clean":"2024-04-26T00:50:41.467910+0000","last_became_active":"2024-04-26T00:50:38.868002+0000","last_became_peered":"2024-04-26T00:50:38.868002+0000","last_unstale":"2024-04-26T00:50:41.467910+0000","last_undegraded":"2024-04-26T00:50:41.467910+0000","last_fullsized":"2024-04-26T00:50:41.467910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:39.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850433+0000","last_change":"2024-04-26T00:50:39.857039+0000","last_active":"2024-04-26T00:50:40.850433+0000","last_peered":"2024-04-26T00:50:40.850433+0000","last_clean":"2024-04-26T00:50:40.850433+0000","last_became_active":"2024-04-26T00:50:39.856666+0000","last_became_peered":"2024-04-26T00:50:39.856666+0000","last_unstale":"2024-04-26T00:50:40.850433+0000","last_undegraded":"2024-04-26T00:50:40.850433+0000","last_fullsized":"2024-04-26T00:50:40.850433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852110+0000","last_change":"2024-04-26T00:50:38.849900+0000","last_active":"2024-04-26T00:50:40.852110+0000","last_peered":"2024-04-26T00:50:40.852110+0000","last_clean":"2024-04-26T00:50:40.852110+0000","last_became_active":"2024-04-26T00:50:38.849354+0000","last_became_peered":"2024-04-26T00:50:38.849354+0000","last_unstale":"2024-04-26T00:50:40.852110+0000","last_undegraded":"2024-04-26T00:50:40.852110+0000","last_fullsized":"2024-04-26T00:50:40.852110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:38.438162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467384+0000","last_change":"2024-04-26T00:50:39.863655+0000","last_active":"2024-04-26T00:50:41.467384+0000","last_peered":"2024-04-26T00:50:41.467384+0000","last_clean":"2024-04-26T00:50:41.467384+0000","last_became_active":"2024-04-26T00:50:39.863378+0000","last_became_peered":"2024-04-26T00:50:39.863378+0000","last_unstale":"2024-04-26T00:50:41.467384+0000","last_undegraded":"2024-04-26T00:50:41.467384+0000","last_fullsized":"2024-04-26T00:50:41.467384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467256+0000","last_change":"2024-04-26T00:50:38.876385+0000","last_active":"2024-04-26T00:50:41.467256+0000","last_peered":"2024-04-26T00:50:41.467256+0000","last_clean":"2024-04-26T00:50:41.467256+0000","last_became_active":"2024-04-26T00:50:38.875458+0000","last_became_peered":"2024-04-26T00:50:38.875458+0000","last_unstale":"2024-04-26T00:50:41.467256+0000","last_undegraded":"2024-04-26T00:50:41.467256+0000","last_fullsized":"2024-04-26T00:50:41.467256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849703+0000","last_change":"2024-04-26T00:50:39.847368+0000","last_active":"2024-04-26T00:50:40.849703+0000","last_peered":"2024-04-26T00:50:40.849703+0000","last_clean":"2024-04-26T00:50:40.849703+0000","last_became_active":"2024-04-26T00:50:39.845961+0000","last_became_peered":"2024-04-26T00:50:39.845961+0000","last_unstale":"2024-04-26T00:50:40.849703+0000","last_undegraded":"2024-04-26T00:50:40.849703+0000","last_fullsized":"2024-04-26T00:50:40.849703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469540+0000","last_change":"2024-04-26T00:50:38.873696+0000","last_active":"2024-04-26T00:50:41.469540+0000","last_peered":"2024-04-26T00:50:41.469540+0000","last_clean":"2024-04-26T00:50:41.469540+0000","last_became_active":"2024-04-26T00:50:38.873136+0000","last_became_peered":"2024-04-26T00:50:38.873136+0000","last_unstale":"2024-04-26T00:50:41.469540+0000","last_undegraded":"2024-04-26T00:50:41.469540+0000","last_fullsized":"2024-04-26T00:50:41.469540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:19.993664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705673,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":656236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":654556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:51.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 Processor -- start 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 -- start start 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52880aab80 con 0x7f52880bb470 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5288137bf0 con 0x7f52881380d0 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528f7b2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f52880ac990 con 0x7f5288137690 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.096+0000 7f528cd4d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60846/0 (socket says 172.21.15.6:60846) 2024-04-26T00:50:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 -- 172.21.15.6:0/3188020616 learned_addr learned my addr 172.21.15.6:0/3188020616 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 -- 172.21.15.6:0/3188020616 >> v1:172.21.15.188:6789/0 conn(0x7f52881380d0 legacy=0x7f528806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 -- 172.21.15.6:0/3188020616 >> v1:172.21.15.6:6789/0 conn(0x7f52880bb470 legacy=0x7f528814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 -- 172.21.15.6:0/3188020616 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5288137eb0 con 0x7f5288137690 2024-04-26T00:50:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528cd4d640 1 --2- 172.21.15.6:0/3188020616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098a0 tx=0x7f527c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ec296139719652 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f5287fff640 1 -- 172.21.15.6:0/3188020616 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c0a9400 con 0x7f5288137690 2024-04-26T00:50:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f5287fff640 1 -- 172.21.15.6:0/3188020616 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c0a95a0 con 0x7f5288137690 2024-04-26T00:50:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f5287fff640 1 -- 172.21.15.6:0/3188020616 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c0a9970 con 0x7f5288137690 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 -- 172.21.15.6:0/3188020616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 msgr2=0x7f52880ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 --2- 172.21.15.6:0/3188020616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098a0 tx=0x7f527c01c520 comp rx=0 tx=0).stop 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 -- 172.21.15.6:0/3188020616 shutdown_connections 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 --2- 172.21.15.6:0/3188020616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f52880ac340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 -- 172.21.15.6:0/3188020616 >> 172.21.15.6:0/3188020616 conn(0x7f528806e400 msgr2=0x7f52880bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 -- 172.21.15.6:0/3188020616 shutdown_connections 2024-04-26T00:50:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.100+0000 7f528f7b2640 1 -- 172.21.15.6:0/3188020616 wait complete. 2024-04-26T00:50:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 Processor -- start 2024-04-26T00:50:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- start start 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f5288149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52881380d0 0x7f52881453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5288153940 con 0x7f52880bb470 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52881537c0 con 0x7f52881380d0 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5288153ac0 con 0x7f5288137690 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528cd4d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f5288149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37566/0 (socket says 172.21.15.6:37566) 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 -- 172.21.15.6:0/966952476 learned_addr learned my addr 172.21.15.6:0/966952476 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528cd4d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f5288149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60862/0 (socket says 172.21.15.6:60862) 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 -- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 msgr2=0x7f5288149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f5288149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 -- 172.21.15.6:0/966952476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52881380d0 msgr2=0x7f52881453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52881380d0 0x7f52881453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 -- 172.21.15.6:0/966952476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528814f200 con 0x7f52880bb470 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528d54e640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f528000c7f0 tx=0x7f528000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280016020 con 0x7f52880bb470 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528000aa50 con 0x7f52880bb470 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528814c3a0 con 0x7f52880bb470 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528000ae40 con 0x7f52880bb470 2024-04-26T00:50:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52881463c0 con 0x7f52880bb470 2024-04-26T00:50:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528806db70 con 0x7f52880bb470 2024-04-26T00:50:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f5280019020 con 0x7f52880bb470 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.104+0000 7f5285ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 0x7f527409b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f528cd4d640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 0x7f527409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f52800c27b0 con 0x7f52880bb470 2024-04-26T00:50:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f528cd4d640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 0x7f527409b780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f527c0ae000 tx=0x7f527c0b3040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.108+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5280020030 con 0x7f52880bb470 2024-04-26T00:50:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.264+0000 7f528f7b2640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-26T00:50:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.264+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 --> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52880b9210 con 0x7f52740992c0 2024-04-26T00:50:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.284+0000 7f5285ffb640 1 -- 172.21.15.6:0/966952476 <== mgr.4113 v2:172.21.15.6:6808/3851499451 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268542 (secure 0 0 0) 0x7f52880b9210 con 0x7f52740992c0 2024-04-26T00:50:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.284+0000 7f5285ffb640 20 mgrc handle_command_reply tid 0 r 0 2024-04-26T00:50:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.284+0000 7f528f7b2640 10 mgrc shutdown 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.284+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 msgr2=0x7f527409b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.284+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 0x7f527409b780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f527c0ae000 tx=0x7f527c0b3040 comp rx=0 tx=0).stop 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 msgr2=0x7f528814afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f528000c7f0 tx=0x7f528000ccb0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 shutdown_connections 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f52740992c0 0x7f527409b780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52881380d0 0x7f52881453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5288137690 0x7f5288149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 --2- 172.21.15.6:0/966952476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52880bb470 0x7f528814afb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 >> 172.21.15.6:0/966952476 conn(0x7f528806e400 msgr2=0x7f528806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 shutdown_connections 2024-04-26T00:50:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.288+0000 7f528f7b2640 1 -- 172.21.15.6:0/966952476 wait complete. 2024-04-26T00:50:52.312 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-26T00:50:52.258596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114192,"kb_used_data":1944,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373168,"statfs":{"total":386547056640,"available":386430124032,"internally_reserved":0,"allocated":1990656,"data_stored":1439892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.413282"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855209+0000","last_change":"2024-04-26T00:50:39.864060+0000","last_active":"2024-04-26T00:50:40.855209+0000","last_peered":"2024-04-26T00:50:40.855209+0000","last_clean":"2024-04-26T00:50:40.855209+0000","last_became_active":"2024-04-26T00:50:39.863233+0000","last_became_peered":"2024-04-26T00:50:39.863233+0000","last_unstale":"2024-04-26T00:50:40.855209+0000","last_undegraded":"2024-04-26T00:50:40.855209+0000","last_fullsized":"2024-04-26T00:50:40.855209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:27.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.858910+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858358+0000","last_became_peered":"2024-04-26T00:50:39.858358+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.333493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851636+0000","last_change":"2024-04-26T00:50:39.859022+0000","last_active":"2024-04-26T00:50:40.851636+0000","last_peered":"2024-04-26T00:50:40.851636+0000","last_clean":"2024-04-26T00:50:40.851636+0000","last_became_active":"2024-04-26T00:50:39.858634+0000","last_became_peered":"2024-04-26T00:50:39.858634+0000","last_unstale":"2024-04-26T00:50:40.851636+0000","last_undegraded":"2024-04-26T00:50:40.851636+0000","last_fullsized":"2024-04-26T00:50:40.851636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:01:18.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464955+0000","last_change":"2024-04-26T00:50:39.861410+0000","last_active":"2024-04-26T00:50:41.464955+0000","last_peered":"2024-04-26T00:50:41.464955+0000","last_clean":"2024-04-26T00:50:41.464955+0000","last_became_active":"2024-04-26T00:50:39.860413+0000","last_became_peered":"2024-04-26T00:50:39.860413+0000","last_unstale":"2024-04-26T00:50:41.464955+0000","last_undegraded":"2024-04-26T00:50:41.464955+0000","last_fullsized":"2024-04-26T00:50:41.464955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465774+0000","last_change":"2024-04-26T00:50:39.854723+0000","last_active":"2024-04-26T00:50:41.465774+0000","last_peered":"2024-04-26T00:50:41.465774+0000","last_clean":"2024-04-26T00:50:41.465774+0000","last_became_active":"2024-04-26T00:50:39.854507+0000","last_became_peered":"2024-04-26T00:50:39.854507+0000","last_unstale":"2024-04-26T00:50:41.465774+0000","last_undegraded":"2024-04-26T00:50:41.465774+0000","last_fullsized":"2024-04-26T00:50:41.465774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:58.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465520+0000","last_change":"2024-04-26T00:50:39.848920+0000","last_active":"2024-04-26T00:50:41.465520+0000","last_peered":"2024-04-26T00:50:41.465520+0000","last_clean":"2024-04-26T00:50:41.465520+0000","last_became_active":"2024-04-26T00:50:39.848576+0000","last_became_peered":"2024-04-26T00:50:39.848576+0000","last_unstale":"2024-04-26T00:50:41.465520+0000","last_undegraded":"2024-04-26T00:50:41.465520+0000","last_fullsized":"2024-04-26T00:50:41.465520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:00.751396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465029+0000","last_change":"2024-04-26T00:50:39.848389+0000","last_active":"2024-04-26T00:50:41.465029+0000","last_peered":"2024-04-26T00:50:41.465029+0000","last_clean":"2024-04-26T00:50:41.465029+0000","last_became_active":"2024-04-26T00:50:39.847874+0000","last_became_peered":"2024-04-26T00:50:39.847874+0000","last_unstale":"2024-04-26T00:50:41.465029+0000","last_undegraded":"2024-04-26T00:50:41.465029+0000","last_fullsized":"2024-04-26T00:50:41.465029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:28.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849307+0000","last_change":"2024-04-26T00:50:39.863022+0000","last_active":"2024-04-26T00:50:40.849307+0000","last_peered":"2024-04-26T00:50:40.849307+0000","last_clean":"2024-04-26T00:50:40.849307+0000","last_became_active":"2024-04-26T00:50:39.862653+0000","last_became_peered":"2024-04-26T00:50:39.862653+0000","last_unstale":"2024-04-26T00:50:40.849307+0000","last_undegraded":"2024-04-26T00:50:40.849307+0000","last_fullsized":"2024-04-26T00:50:40.849307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855363+0000","last_change":"2024-04-26T00:50:39.864364+0000","last_active":"2024-04-26T00:50:40.855363+0000","last_peered":"2024-04-26T00:50:40.855363+0000","last_clean":"2024-04-26T00:50:40.855363+0000","last_became_active":"2024-04-26T00:50:39.863765+0000","last_became_peered":"2024-04-26T00:50:39.863765+0000","last_unstale":"2024-04-26T00:50:40.855363+0000","last_undegraded":"2024-04-26T00:50:40.855363+0000","last_fullsized":"2024-04-26T00:50:40.855363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:03.262591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468765+0000","last_change":"2024-04-26T00:50:39.860856+0000","last_active":"2024-04-26T00:50:41.468765+0000","last_peered":"2024-04-26T00:50:41.468765+0000","last_clean":"2024-04-26T00:50:41.468765+0000","last_became_active":"2024-04-26T00:50:39.860592+0000","last_became_peered":"2024-04-26T00:50:39.860592+0000","last_unstale":"2024-04-26T00:50:41.468765+0000","last_undegraded":"2024-04-26T00:50:41.468765+0000","last_fullsized":"2024-04-26T00:50:41.468765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468466+0000","last_change":"2024-04-26T00:50:39.854576+0000","last_active":"2024-04-26T00:50:41.468466+0000","last_peered":"2024-04-26T00:50:41.468466+0000","last_clean":"2024-04-26T00:50:41.468466+0000","last_became_active":"2024-04-26T00:50:39.854290+0000","last_became_peered":"2024-04-26T00:50:39.854290+0000","last_unstale":"2024-04-26T00:50:41.468466+0000","last_undegraded":"2024-04-26T00:50:41.468466+0000","last_fullsized":"2024-04-26T00:50:41.468466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:31.007756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855221+0000","last_change":"2024-04-26T00:50:39.867495+0000","last_active":"2024-04-26T00:50:40.855221+0000","last_peered":"2024-04-26T00:50:40.855221+0000","last_clean":"2024-04-26T00:50:40.855221+0000","last_became_active":"2024-04-26T00:50:39.866525+0000","last_became_peered":"2024-04-26T00:50:39.866525+0000","last_unstale":"2024-04-26T00:50:40.855221+0000","last_undegraded":"2024-04-26T00:50:40.855221+0000","last_fullsized":"2024-04-26T00:50:40.855221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854314+0000","last_change":"2024-04-26T00:50:39.866036+0000","last_active":"2024-04-26T00:50:40.854314+0000","last_peered":"2024-04-26T00:50:40.854314+0000","last_clean":"2024-04-26T00:50:40.854314+0000","last_became_active":"2024-04-26T00:50:39.864772+0000","last_became_peered":"2024-04-26T00:50:39.864772+0000","last_unstale":"2024-04-26T00:50:40.854314+0000","last_undegraded":"2024-04-26T00:50:40.854314+0000","last_fullsized":"2024-04-26T00:50:40.854314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:20.673745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850148+0000","last_change":"2024-04-26T00:50:39.850402+0000","last_active":"2024-04-26T00:50:40.850148+0000","last_peered":"2024-04-26T00:50:40.850148+0000","last_clean":"2024-04-26T00:50:40.850148+0000","last_became_active":"2024-04-26T00:50:39.849824+0000","last_became_peered":"2024-04-26T00:50:39.849824+0000","last_unstale":"2024-04-26T00:50:40.850148+0000","last_undegraded":"2024-04-26T00:50:40.850148+0000","last_fullsized":"2024-04-26T00:50:40.850148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849803+0000","last_change":"2024-04-26T00:50:39.859504+0000","last_active":"2024-04-26T00:50:40.849803+0000","last_peered":"2024-04-26T00:50:40.849803+0000","last_clean":"2024-04-26T00:50:40.849803+0000","last_became_active":"2024-04-26T00:50:39.858895+0000","last_became_peered":"2024-04-26T00:50:39.858895+0000","last_unstale":"2024-04-26T00:50:40.849803+0000","last_undegraded":"2024-04-26T00:50:40.849803+0000","last_fullsized":"2024-04-26T00:50:40.849803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849230+0000","last_change":"2024-04-26T00:50:39.862674+0000","last_active":"2024-04-26T00:50:40.849230+0000","last_peered":"2024-04-26T00:50:40.849230+0000","last_clean":"2024-04-26T00:50:40.849230+0000","last_became_active":"2024-04-26T00:50:39.862064+0000","last_became_peered":"2024-04-26T00:50:39.862064+0000","last_unstale":"2024-04-26T00:50:40.849230+0000","last_undegraded":"2024-04-26T00:50:40.849230+0000","last_fullsized":"2024-04-26T00:50:40.849230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469383+0000","last_change":"2024-04-26T00:50:39.868719+0000","last_active":"2024-04-26T00:50:41.469383+0000","last_peered":"2024-04-26T00:50:41.469383+0000","last_clean":"2024-04-26T00:50:41.469383+0000","last_became_active":"2024-04-26T00:50:39.868234+0000","last_became_peered":"2024-04-26T00:50:39.868234+0000","last_unstale":"2024-04-26T00:50:41.469383+0000","last_undegraded":"2024-04-26T00:50:41.469383+0000","last_fullsized":"2024-04-26T00:50:41.469383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467114+0000","last_change":"2024-04-26T00:50:39.864259+0000","last_active":"2024-04-26T00:50:41.467114+0000","last_peered":"2024-04-26T00:50:41.467114+0000","last_clean":"2024-04-26T00:50:41.467114+0000","last_became_active":"2024-04-26T00:50:39.863983+0000","last_became_peered":"2024-04-26T00:50:39.863983+0000","last_unstale":"2024-04-26T00:50:41.467114+0000","last_undegraded":"2024-04-26T00:50:41.467114+0000","last_fullsized":"2024-04-26T00:50:41.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854744+0000","last_change":"2024-04-26T00:50:39.865590+0000","last_active":"2024-04-26T00:50:40.854744+0000","last_peered":"2024-04-26T00:50:40.854744+0000","last_clean":"2024-04-26T00:50:40.854744+0000","last_became_active":"2024-04-26T00:50:39.865319+0000","last_became_peered":"2024-04-26T00:50:39.865319+0000","last_unstale":"2024-04-26T00:50:40.854744+0000","last_undegraded":"2024-04-26T00:50:40.854744+0000","last_fullsized":"2024-04-26T00:50:40.854744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:20.997241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467605+0000","last_change":"2024-04-26T00:50:39.856108+0000","last_active":"2024-04-26T00:50:41.467605+0000","last_peered":"2024-04-26T00:50:41.467605+0000","last_clean":"2024-04-26T00:50:41.467605+0000","last_became_active":"2024-04-26T00:50:39.855807+0000","last_became_peered":"2024-04-26T00:50:39.855807+0000","last_unstale":"2024-04-26T00:50:41.467605+0000","last_undegraded":"2024-04-26T00:50:41.467605+0000","last_fullsized":"2024-04-26T00:50:41.467605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850863+0000","last_change":"2024-04-26T00:50:39.843134+0000","last_active":"2024-04-26T00:50:40.850863+0000","last_peered":"2024-04-26T00:50:40.850863+0000","last_clean":"2024-04-26T00:50:40.850863+0000","last_became_active":"2024-04-26T00:50:39.842326+0000","last_became_peered":"2024-04-26T00:50:39.842326+0000","last_unstale":"2024-04-26T00:50:40.850863+0000","last_undegraded":"2024-04-26T00:50:40.850863+0000","last_fullsized":"2024-04-26T00:50:40.850863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:10:05.591117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464540+0000","last_change":"2024-04-26T00:50:39.854346+0000","last_active":"2024-04-26T00:50:41.464540+0000","last_peered":"2024-04-26T00:50:41.464540+0000","last_clean":"2024-04-26T00:50:41.464540+0000","last_became_active":"2024-04-26T00:50:39.854039+0000","last_became_peered":"2024-04-26T00:50:39.854039+0000","last_unstale":"2024-04-26T00:50:41.464540+0000","last_undegraded":"2024-04-26T00:50:41.464540+0000","last_fullsized":"2024-04-26T00:50:41.464540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465787+0000","last_change":"2024-04-26T00:50:39.860520+0000","last_active":"2024-04-26T00:50:41.465787+0000","last_peered":"2024-04-26T00:50:41.465787+0000","last_clean":"2024-04-26T00:50:41.465787+0000","last_became_active":"2024-04-26T00:50:39.859357+0000","last_became_peered":"2024-04-26T00:50:39.859357+0000","last_unstale":"2024-04-26T00:50:41.465787+0000","last_undegraded":"2024-04-26T00:50:41.465787+0000","last_fullsized":"2024-04-26T00:50:41.465787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:53.199936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849398+0000","last_change":"2024-04-26T00:50:39.858882+0000","last_active":"2024-04-26T00:50:40.849398+0000","last_peered":"2024-04-26T00:50:40.849398+0000","last_clean":"2024-04-26T00:50:40.849398+0000","last_became_active":"2024-04-26T00:50:39.858565+0000","last_became_peered":"2024-04-26T00:50:39.858565+0000","last_unstale":"2024-04-26T00:50:40.849398+0000","last_undegraded":"2024-04-26T00:50:40.849398+0000","last_fullsized":"2024-04-26T00:50:40.849398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:32:52.813605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468918+0000","last_change":"2024-04-26T00:50:39.857963+0000","last_active":"2024-04-26T00:50:41.468918+0000","last_peered":"2024-04-26T00:50:41.468918+0000","last_clean":"2024-04-26T00:50:41.468918+0000","last_became_active":"2024-04-26T00:50:39.857599+0000","last_became_peered":"2024-04-26T00:50:39.857599+0000","last_unstale":"2024-04-26T00:50:41.468918+0000","last_undegraded":"2024-04-26T00:50:41.468918+0000","last_fullsized":"2024-04-26T00:50:41.468918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469225+0000","last_change":"2024-04-26T00:50:39.863645+0000","last_active":"2024-04-26T00:50:41.469225+0000","last_peered":"2024-04-26T00:50:41.469225+0000","last_clean":"2024-04-26T00:50:41.469225+0000","last_became_active":"2024-04-26T00:50:39.863391+0000","last_became_peered":"2024-04-26T00:50:39.863391+0000","last_unstale":"2024-04-26T00:50:41.469225+0000","last_undegraded":"2024-04-26T00:50:41.469225+0000","last_fullsized":"2024-04-26T00:50:41.469225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852851+0000","last_change":"2024-04-26T00:50:39.860126+0000","last_active":"2024-04-26T00:50:40.852851+0000","last_peered":"2024-04-26T00:50:40.852851+0000","last_clean":"2024-04-26T00:50:40.852851+0000","last_became_active":"2024-04-26T00:50:39.859701+0000","last_became_peered":"2024-04-26T00:50:39.859701+0000","last_unstale":"2024-04-26T00:50:40.852851+0000","last_undegraded":"2024-04-26T00:50:40.852851+0000","last_fullsized":"2024-04-26T00:50:40.852851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:26:07.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468277+0000","last_change":"2024-04-26T00:50:39.868579+0000","last_active":"2024-04-26T00:50:41.468277+0000","last_peered":"2024-04-26T00:50:41.468277+0000","last_clean":"2024-04-26T00:50:41.468277+0000","last_became_active":"2024-04-26T00:50:39.868213+0000","last_became_peered":"2024-04-26T00:50:39.868213+0000","last_unstale":"2024-04-26T00:50:41.468277+0000","last_undegraded":"2024-04-26T00:50:41.468277+0000","last_fullsized":"2024-04-26T00:50:41.468277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465290+0000","last_change":"2024-04-26T00:50:39.855232+0000","last_active":"2024-04-26T00:50:41.465290+0000","last_peered":"2024-04-26T00:50:41.465290+0000","last_clean":"2024-04-26T00:50:41.465290+0000","last_became_active":"2024-04-26T00:50:39.852449+0000","last_became_peered":"2024-04-26T00:50:39.852449+0000","last_unstale":"2024-04-26T00:50:41.465290+0000","last_undegraded":"2024-04-26T00:50:41.465290+0000","last_fullsized":"2024-04-26T00:50:41.465290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:10.850384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465536+0000","last_change":"2024-04-26T00:50:39.852258+0000","last_active":"2024-04-26T00:50:41.465536+0000","last_peered":"2024-04-26T00:50:41.465536+0000","last_clean":"2024-04-26T00:50:41.465536+0000","last_became_active":"2024-04-26T00:50:39.851730+0000","last_became_peered":"2024-04-26T00:50:39.851730+0000","last_unstale":"2024-04-26T00:50:41.465536+0000","last_undegraded":"2024-04-26T00:50:41.465536+0000","last_fullsized":"2024-04-26T00:50:41.465536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465455+0000","last_change":"2024-04-26T00:50:39.848331+0000","last_active":"2024-04-26T00:50:41.465455+0000","last_peered":"2024-04-26T00:50:41.465455+0000","last_clean":"2024-04-26T00:50:41.465455+0000","last_became_active":"2024-04-26T00:50:39.848027+0000","last_became_peered":"2024-04-26T00:50:39.848027+0000","last_unstale":"2024-04-26T00:50:41.465455+0000","last_undegraded":"2024-04-26T00:50:41.465455+0000","last_fullsized":"2024-04-26T00:50:41.465455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:01:10.545861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849646+0000","last_change":"2024-04-26T00:50:39.862385+0000","last_active":"2024-04-26T00:50:40.849646+0000","last_peered":"2024-04-26T00:50:40.849646+0000","last_clean":"2024-04-26T00:50:40.849646+0000","last_became_active":"2024-04-26T00:50:39.861979+0000","last_became_peered":"2024-04-26T00:50:39.861979+0000","last_unstale":"2024-04-26T00:50:40.849646+0000","last_undegraded":"2024-04-26T00:50:40.849646+0000","last_fullsized":"2024-04-26T00:50:40.849646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:33.450550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465788+0000","last_change":"2024-04-26T00:50:39.857971+0000","last_active":"2024-04-26T00:50:41.465788+0000","last_peered":"2024-04-26T00:50:41.465788+0000","last_clean":"2024-04-26T00:50:41.465788+0000","last_became_active":"2024-04-26T00:50:39.857706+0000","last_became_peered":"2024-04-26T00:50:39.857706+0000","last_unstale":"2024-04-26T00:50:41.465788+0000","last_undegraded":"2024-04-26T00:50:41.465788+0000","last_fullsized":"2024-04-26T00:50:41.465788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466603+0000","last_change":"2024-04-26T00:50:38.870203+0000","last_active":"2024-04-26T00:50:41.466603+0000","last_peered":"2024-04-26T00:50:41.466603+0000","last_clean":"2024-04-26T00:50:41.466603+0000","last_became_active":"2024-04-26T00:50:38.869667+0000","last_became_peered":"2024-04-26T00:50:38.869667+0000","last_unstale":"2024-04-26T00:50:41.466603+0000","last_undegraded":"2024-04-26T00:50:41.466603+0000","last_fullsized":"2024-04-26T00:50:41.466603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:30.946855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466766+0000","last_change":"2024-04-26T00:50:39.851780+0000","last_active":"2024-04-26T00:50:41.466766+0000","last_peered":"2024-04-26T00:50:41.466766+0000","last_clean":"2024-04-26T00:50:41.466766+0000","last_became_active":"2024-04-26T00:50:39.851487+0000","last_became_peered":"2024-04-26T00:50:39.851487+0000","last_unstale":"2024-04-26T00:50:41.466766+0000","last_undegraded":"2024-04-26T00:50:41.466766+0000","last_fullsized":"2024-04-26T00:50:41.466766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854350+0000","last_change":"2024-04-26T00:50:38.858405+0000","last_active":"2024-04-26T00:50:40.854350+0000","last_peered":"2024-04-26T00:50:40.854350+0000","last_clean":"2024-04-26T00:50:40.854350+0000","last_became_active":"2024-04-26T00:50:38.857294+0000","last_became_peered":"2024-04-26T00:50:38.857294+0000","last_unstale":"2024-04-26T00:50:40.854350+0000","last_undegraded":"2024-04-26T00:50:40.854350+0000","last_fullsized":"2024-04-26T00:50:40.854350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:35.943770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466331+0000","last_change":"2024-04-26T00:50:39.854371+0000","last_active":"2024-04-26T00:50:41.466331+0000","last_peered":"2024-04-26T00:50:41.466331+0000","last_clean":"2024-04-26T00:50:41.466331+0000","last_became_active":"2024-04-26T00:50:39.851258+0000","last_became_peered":"2024-04-26T00:50:39.851258+0000","last_unstale":"2024-04-26T00:50:41.466331+0000","last_undegraded":"2024-04-26T00:50:41.466331+0000","last_fullsized":"2024-04-26T00:50:41.466331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:01.214640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850071+0000","last_change":"2024-04-26T00:50:38.855662+0000","last_active":"2024-04-26T00:50:40.850071+0000","last_peered":"2024-04-26T00:50:40.850071+0000","last_clean":"2024-04-26T00:50:40.850071+0000","last_became_active":"2024-04-26T00:50:38.855264+0000","last_became_peered":"2024-04-26T00:50:38.855264+0000","last_unstale":"2024-04-26T00:50:40.850071+0000","last_undegraded":"2024-04-26T00:50:40.850071+0000","last_fullsized":"2024-04-26T00:50:40.850071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:54.888616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468580+0000","last_change":"2024-04-26T00:50:39.860246+0000","last_active":"2024-04-26T00:50:41.468580+0000","last_peered":"2024-04-26T00:50:41.468580+0000","last_clean":"2024-04-26T00:50:41.468580+0000","last_became_active":"2024-04-26T00:50:39.859961+0000","last_became_peered":"2024-04-26T00:50:39.859961+0000","last_unstale":"2024-04-26T00:50:41.468580+0000","last_undegraded":"2024-04-26T00:50:41.468580+0000","last_fullsized":"2024-04-26T00:50:41.468580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:44.770762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849532+0000","last_change":"2024-04-26T00:50:38.858626+0000","last_active":"2024-04-26T00:50:40.849532+0000","last_peered":"2024-04-26T00:50:40.849532+0000","last_clean":"2024-04-26T00:50:40.849532+0000","last_became_active":"2024-04-26T00:50:38.858137+0000","last_became_peered":"2024-04-26T00:50:38.858137+0000","last_unstale":"2024-04-26T00:50:40.849532+0000","last_undegraded":"2024-04-26T00:50:40.849532+0000","last_fullsized":"2024-04-26T00:50:40.849532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:38.523333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852229+0000","last_change":"2024-04-26T00:50:38.873856+0000","last_active":"2024-04-26T00:50:40.852229+0000","last_peered":"2024-04-26T00:50:40.852229+0000","last_clean":"2024-04-26T00:50:40.852229+0000","last_became_active":"2024-04-26T00:50:38.873335+0000","last_became_peered":"2024-04-26T00:50:38.873335+0000","last_unstale":"2024-04-26T00:50:40.852229+0000","last_undegraded":"2024-04-26T00:50:40.852229+0000","last_fullsized":"2024-04-26T00:50:40.852229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:50.382396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465911+0000","last_change":"2024-04-26T00:50:39.848253+0000","last_active":"2024-04-26T00:50:41.465911+0000","last_peered":"2024-04-26T00:50:41.465911+0000","last_clean":"2024-04-26T00:50:41.465911+0000","last_became_active":"2024-04-26T00:50:39.847884+0000","last_became_peered":"2024-04-26T00:50:39.847884+0000","last_unstale":"2024-04-26T00:50:41.465911+0000","last_undegraded":"2024-04-26T00:50:41.465911+0000","last_fullsized":"2024-04-26T00:50:41.465911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:19:29.170304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851684+0000","last_change":"2024-04-26T00:50:38.845913+0000","last_active":"2024-04-26T00:50:40.851684+0000","last_peered":"2024-04-26T00:50:40.851684+0000","last_clean":"2024-04-26T00:50:40.851684+0000","last_became_active":"2024-04-26T00:50:38.845248+0000","last_became_peered":"2024-04-26T00:50:38.845248+0000","last_unstale":"2024-04-26T00:50:40.851684+0000","last_undegraded":"2024-04-26T00:50:40.851684+0000","last_fullsized":"2024-04-26T00:50:40.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:01:14.839151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465102+0000","last_change":"2024-04-26T00:50:39.862106+0000","last_active":"2024-04-26T00:50:41.465102+0000","last_peered":"2024-04-26T00:50:41.465102+0000","last_clean":"2024-04-26T00:50:41.465102+0000","last_became_active":"2024-04-26T00:50:39.861838+0000","last_became_peered":"2024-04-26T00:50:39.861838+0000","last_unstale":"2024-04-26T00:50:41.465102+0000","last_undegraded":"2024-04-26T00:50:41.465102+0000","last_fullsized":"2024-04-26T00:50:41.465102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852430+0000","last_change":"2024-04-26T00:50:38.869341+0000","last_active":"2024-04-26T00:50:40.852430+0000","last_peered":"2024-04-26T00:50:40.852430+0000","last_clean":"2024-04-26T00:50:40.852430+0000","last_became_active":"2024-04-26T00:50:38.868538+0000","last_became_peered":"2024-04-26T00:50:38.868538+0000","last_unstale":"2024-04-26T00:50:40.852430+0000","last_undegraded":"2024-04-26T00:50:40.852430+0000","last_fullsized":"2024-04-26T00:50:40.852430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:09.233129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850440+0000","last_change":"2024-04-26T00:50:39.838874+0000","last_active":"2024-04-26T00:50:40.850440+0000","last_peered":"2024-04-26T00:50:40.850440+0000","last_clean":"2024-04-26T00:50:40.850440+0000","last_became_active":"2024-04-26T00:50:39.838130+0000","last_became_peered":"2024-04-26T00:50:39.838130+0000","last_unstale":"2024-04-26T00:50:40.850440+0000","last_undegraded":"2024-04-26T00:50:40.850440+0000","last_fullsized":"2024-04-26T00:50:40.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:17.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851387+0000","last_change":"2024-04-26T00:50:38.852912+0000","last_active":"2024-04-26T00:50:40.851387+0000","last_peered":"2024-04-26T00:50:40.851387+0000","last_clean":"2024-04-26T00:50:40.851387+0000","last_became_active":"2024-04-26T00:50:38.852425+0000","last_became_peered":"2024-04-26T00:50:38.852425+0000","last_unstale":"2024-04-26T00:50:40.851387+0000","last_undegraded":"2024-04-26T00:50:40.851387+0000","last_fullsized":"2024-04-26T00:50:40.851387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:26.487714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854707+0000","last_change":"2024-04-26T00:50:39.858386+0000","last_active":"2024-04-26T00:50:40.854707+0000","last_peered":"2024-04-26T00:50:40.854707+0000","last_clean":"2024-04-26T00:50:40.854707+0000","last_became_active":"2024-04-26T00:50:39.858084+0000","last_became_peered":"2024-04-26T00:50:39.858084+0000","last_unstale":"2024-04-26T00:50:40.854707+0000","last_undegraded":"2024-04-26T00:50:40.854707+0000","last_fullsized":"2024-04-26T00:50:40.854707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:24.695303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466946+0000","last_change":"2024-04-26T00:50:38.876499+0000","last_active":"2024-04-26T00:50:41.466946+0000","last_peered":"2024-04-26T00:50:41.466946+0000","last_clean":"2024-04-26T00:50:41.466946+0000","last_became_active":"2024-04-26T00:50:38.875568+0000","last_became_peered":"2024-04-26T00:50:38.875568+0000","last_unstale":"2024-04-26T00:50:41.466946+0000","last_undegraded":"2024-04-26T00:50:41.466946+0000","last_fullsized":"2024-04-26T00:50:41.466946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:08.851681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467684+0000","last_change":"2024-04-26T00:50:39.861634+0000","last_active":"2024-04-26T00:50:41.467684+0000","last_peered":"2024-04-26T00:50:41.467684+0000","last_clean":"2024-04-26T00:50:41.467684+0000","last_became_active":"2024-04-26T00:50:39.860919+0000","last_became_peered":"2024-04-26T00:50:39.860919+0000","last_unstale":"2024-04-26T00:50:41.467684+0000","last_undegraded":"2024-04-26T00:50:41.467684+0000","last_fullsized":"2024-04-26T00:50:41.467684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:01.974131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:38.858272+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:38.857911+0000","last_became_peered":"2024-04-26T00:50:38.857911+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:02.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851832+0000","last_change":"2024-04-26T00:50:39.855731+0000","last_active":"2024-04-26T00:50:40.851832+0000","last_peered":"2024-04-26T00:50:40.851832+0000","last_clean":"2024-04-26T00:50:40.851832+0000","last_became_active":"2024-04-26T00:50:39.855401+0000","last_became_peered":"2024-04-26T00:50:39.855401+0000","last_unstale":"2024-04-26T00:50:40.851832+0000","last_undegraded":"2024-04-26T00:50:40.851832+0000","last_fullsized":"2024-04-26T00:50:40.851832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:05.200373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466079+0000","last_change":"2024-04-26T00:50:38.876014+0000","last_active":"2024-04-26T00:50:41.466079+0000","last_peered":"2024-04-26T00:50:41.466079+0000","last_clean":"2024-04-26T00:50:41.466079+0000","last_became_active":"2024-04-26T00:50:38.875346+0000","last_became_peered":"2024-04-26T00:50:38.875346+0000","last_unstale":"2024-04-26T00:50:41.466079+0000","last_undegraded":"2024-04-26T00:50:41.466079+0000","last_fullsized":"2024-04-26T00:50:41.466079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:12:25.084153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855287+0000","last_change":"2024-04-26T00:50:39.852334+0000","last_active":"2024-04-26T00:50:40.855287+0000","last_peered":"2024-04-26T00:50:40.855287+0000","last_clean":"2024-04-26T00:50:40.855287+0000","last_became_active":"2024-04-26T00:50:39.849126+0000","last_became_peered":"2024-04-26T00:50:39.849126+0000","last_unstale":"2024-04-26T00:50:40.855287+0000","last_undegraded":"2024-04-26T00:50:40.855287+0000","last_fullsized":"2024-04-26T00:50:40.855287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:55.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464952+0000","last_change":"2024-04-26T00:50:38.879815+0000","last_active":"2024-04-26T00:50:41.464952+0000","last_peered":"2024-04-26T00:50:41.464952+0000","last_clean":"2024-04-26T00:50:41.464952+0000","last_became_active":"2024-04-26T00:50:38.876392+0000","last_became_peered":"2024-04-26T00:50:38.876392+0000","last_unstale":"2024-04-26T00:50:41.464952+0000","last_undegraded":"2024-04-26T00:50:41.464952+0000","last_fullsized":"2024-04-26T00:50:41.464952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:07.680535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469056+0000","last_change":"2024-04-26T00:50:39.862953+0000","last_active":"2024-04-26T00:50:41.469056+0000","last_peered":"2024-04-26T00:50:41.469056+0000","last_clean":"2024-04-26T00:50:41.469056+0000","last_became_active":"2024-04-26T00:50:39.862133+0000","last_became_peered":"2024-04-26T00:50:39.862133+0000","last_unstale":"2024-04-26T00:50:41.469056+0000","last_undegraded":"2024-04-26T00:50:41.469056+0000","last_fullsized":"2024-04-26T00:50:41.469056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:17.264653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464665+0000","last_change":"2024-04-26T00:50:30.160362+0000","last_active":"2024-04-26T00:50:41.464665+0000","last_peered":"2024-04-26T00:50:41.464665+0000","last_clean":"2024-04-26T00:50:41.464665+0000","last_became_active":"2024-04-26T00:50:30.158205+0000","last_became_peered":"2024-04-26T00:50:30.158205+0000","last_unstale":"2024-04-26T00:50:41.464665+0000","last_undegraded":"2024-04-26T00:50:41.464665+0000","last_fullsized":"2024-04-26T00:50:41.464665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:28.624628+0000","last_clean_scrub_stamp":"2024-04-26T00:50:28.624628+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.334424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851020+0000","last_change":"2024-04-26T00:50:34.698904+0000","last_active":"2024-04-26T00:50:40.851020+0000","last_peered":"2024-04-26T00:50:40.851020+0000","last_clean":"2024-04-26T00:50:40.851020+0000","last_became_active":"2024-04-26T00:50:34.698504+0000","last_became_peered":"2024-04-26T00:50:34.698504+0000","last_unstale":"2024-04-26T00:50:40.851020+0000","last_undegraded":"2024-04-26T00:50:40.851020+0000","last_fullsized":"2024-04-26T00:50:40.851020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:56:35.918624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467042+0000","last_change":"2024-04-26T00:50:38.866703+0000","last_active":"2024-04-26T00:50:41.467042+0000","last_peered":"2024-04-26T00:50:41.467042+0000","last_clean":"2024-04-26T00:50:41.467042+0000","last_became_active":"2024-04-26T00:50:38.866123+0000","last_became_peered":"2024-04-26T00:50:38.866123+0000","last_unstale":"2024-04-26T00:50:41.467042+0000","last_undegraded":"2024-04-26T00:50:41.467042+0000","last_fullsized":"2024-04-26T00:50:41.467042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:09.927849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852406+0000","last_change":"2024-04-26T00:50:39.859004+0000","last_active":"2024-04-26T00:50:40.852406+0000","last_peered":"2024-04-26T00:50:40.852406+0000","last_clean":"2024-04-26T00:50:40.852406+0000","last_became_active":"2024-04-26T00:50:39.858536+0000","last_became_peered":"2024-04-26T00:50:39.858536+0000","last_unstale":"2024-04-26T00:50:40.852406+0000","last_undegraded":"2024-04-26T00:50:40.852406+0000","last_fullsized":"2024-04-26T00:50:40.852406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:44.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849761+0000","last_change":"2024-04-26T00:50:34.691559+0000","last_active":"2024-04-26T00:50:40.849761+0000","last_peered":"2024-04-26T00:50:40.849761+0000","last_clean":"2024-04-26T00:50:40.849761+0000","last_became_active":"2024-04-26T00:50:34.691024+0000","last_became_peered":"2024-04-26T00:50:34.691024+0000","last_unstale":"2024-04-26T00:50:40.849761+0000","last_undegraded":"2024-04-26T00:50:40.849761+0000","last_fullsized":"2024-04-26T00:50:40.849761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465609+0000","last_change":"2024-04-26T00:50:38.862050+0000","last_active":"2024-04-26T00:50:41.465609+0000","last_peered":"2024-04-26T00:50:41.465609+0000","last_clean":"2024-04-26T00:50:41.465609+0000","last_became_active":"2024-04-26T00:50:38.861329+0000","last_became_peered":"2024-04-26T00:50:38.861329+0000","last_unstale":"2024-04-26T00:50:41.465609+0000","last_undegraded":"2024-04-26T00:50:41.465609+0000","last_fullsized":"2024-04-26T00:50:41.465609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:19.670169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466871+0000","last_change":"2024-04-26T00:50:39.859556+0000","last_active":"2024-04-26T00:50:41.466871+0000","last_peered":"2024-04-26T00:50:41.466871+0000","last_clean":"2024-04-26T00:50:41.466871+0000","last_became_active":"2024-04-26T00:50:39.858347+0000","last_became_peered":"2024-04-26T00:50:39.858347+0000","last_unstale":"2024-04-26T00:50:41.466871+0000","last_undegraded":"2024-04-26T00:50:41.466871+0000","last_fullsized":"2024-04-26T00:50:41.466871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:02.585065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854116+0000","last_change":"2024-04-26T00:50:35.065115+0000","last_active":"2024-04-26T00:50:40.854116+0000","last_peered":"2024-04-26T00:50:40.854116+0000","last_clean":"2024-04-26T00:50:40.854116+0000","last_became_active":"2024-04-26T00:50:35.064300+0000","last_became_peered":"2024-04-26T00:50:35.064300+0000","last_unstale":"2024-04-26T00:50:40.854116+0000","last_undegraded":"2024-04-26T00:50:40.854116+0000","last_fullsized":"2024-04-26T00:50:40.854116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:04.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464225+0000","last_change":"2024-04-26T00:50:38.864670+0000","last_active":"2024-04-26T00:50:41.464225+0000","last_peered":"2024-04-26T00:50:41.464225+0000","last_clean":"2024-04-26T00:50:41.464225+0000","last_became_active":"2024-04-26T00:50:38.861543+0000","last_became_peered":"2024-04-26T00:50:38.861543+0000","last_unstale":"2024-04-26T00:50:41.464225+0000","last_undegraded":"2024-04-26T00:50:41.464225+0000","last_fullsized":"2024-04-26T00:50:41.464225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469153+0000","last_change":"2024-04-26T00:50:39.862379+0000","last_active":"2024-04-26T00:50:41.469153+0000","last_peered":"2024-04-26T00:50:41.469153+0000","last_clean":"2024-04-26T00:50:41.469153+0000","last_became_active":"2024-04-26T00:50:39.860598+0000","last_became_peered":"2024-04-26T00:50:39.860598+0000","last_unstale":"2024-04-26T00:50:41.469153+0000","last_undegraded":"2024-04-26T00:50:41.469153+0000","last_fullsized":"2024-04-26T00:50:41.469153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:34.165935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851013+0000","last_change":"2024-04-26T00:50:34.692816+0000","last_active":"2024-04-26T00:50:40.851013+0000","last_peered":"2024-04-26T00:50:40.851013+0000","last_clean":"2024-04-26T00:50:40.851013+0000","last_became_active":"2024-04-26T00:50:34.692501+0000","last_became_peered":"2024-04-26T00:50:34.692501+0000","last_unstale":"2024-04-26T00:50:40.851013+0000","last_undegraded":"2024-04-26T00:50:40.851013+0000","last_fullsized":"2024-04-26T00:50:40.851013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:53.130542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850966+0000","last_change":"2024-04-26T00:50:38.857970+0000","last_active":"2024-04-26T00:50:40.850966+0000","last_peered":"2024-04-26T00:50:40.850966+0000","last_clean":"2024-04-26T00:50:40.850966+0000","last_became_active":"2024-04-26T00:50:38.857664+0000","last_became_peered":"2024-04-26T00:50:38.857664+0000","last_unstale":"2024-04-26T00:50:40.850966+0000","last_undegraded":"2024-04-26T00:50:40.850966+0000","last_fullsized":"2024-04-26T00:50:40.850966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:26.406470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467834+0000","last_change":"2024-04-26T00:50:39.868652+0000","last_active":"2024-04-26T00:50:41.467834+0000","last_peered":"2024-04-26T00:50:41.467834+0000","last_clean":"2024-04-26T00:50:41.467834+0000","last_became_active":"2024-04-26T00:50:39.868244+0000","last_became_peered":"2024-04-26T00:50:39.868244+0000","last_unstale":"2024-04-26T00:50:41.467834+0000","last_undegraded":"2024-04-26T00:50:41.467834+0000","last_fullsized":"2024-04-26T00:50:41.467834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852702+0000","last_change":"2024-04-26T00:50:38.868988+0000","last_active":"2024-04-26T00:50:40.852702+0000","last_peered":"2024-04-26T00:50:40.852702+0000","last_clean":"2024-04-26T00:50:40.852702+0000","last_became_active":"2024-04-26T00:50:38.868419+0000","last_became_peered":"2024-04-26T00:50:38.868419+0000","last_unstale":"2024-04-26T00:50:40.852702+0000","last_undegraded":"2024-04-26T00:50:40.852702+0000","last_fullsized":"2024-04-26T00:50:40.852702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.246593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468295+0000","last_change":"2024-04-26T00:50:35.065154+0000","last_active":"2024-04-26T00:50:41.468295+0000","last_peered":"2024-04-26T00:50:41.468295+0000","last_clean":"2024-04-26T00:50:41.468295+0000","last_became_active":"2024-04-26T00:50:35.064373+0000","last_became_peered":"2024-04-26T00:50:35.064373+0000","last_unstale":"2024-04-26T00:50:41.468295+0000","last_undegraded":"2024-04-26T00:50:41.468295+0000","last_fullsized":"2024-04-26T00:50:41.468295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:42:21.565898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464953+0000","last_change":"2024-04-26T00:50:39.855312+0000","last_active":"2024-04-26T00:50:41.464953+0000","last_peered":"2024-04-26T00:50:41.464953+0000","last_clean":"2024-04-26T00:50:41.464953+0000","last_became_active":"2024-04-26T00:50:39.853775+0000","last_became_peered":"2024-04-26T00:50:39.853775+0000","last_unstale":"2024-04-26T00:50:41.464953+0000","last_undegraded":"2024-04-26T00:50:41.464953+0000","last_fullsized":"2024-04-26T00:50:41.464953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:49:53.890284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468158+0000","last_change":"2024-04-26T00:50:38.863255+0000","last_active":"2024-04-26T00:50:41.468158+0000","last_peered":"2024-04-26T00:50:41.468158+0000","last_clean":"2024-04-26T00:50:41.468158+0000","last_became_active":"2024-04-26T00:50:38.861925+0000","last_became_peered":"2024-04-26T00:50:38.861925+0000","last_unstale":"2024-04-26T00:50:41.468158+0000","last_undegraded":"2024-04-26T00:50:41.468158+0000","last_fullsized":"2024-04-26T00:50:41.468158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:37.293965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852840+0000","last_change":"2024-04-26T00:50:34.698775+0000","last_active":"2024-04-26T00:50:40.852840+0000","last_peered":"2024-04-26T00:50:40.852840+0000","last_clean":"2024-04-26T00:50:40.852840+0000","last_became_active":"2024-04-26T00:50:34.698427+0000","last_became_peered":"2024-04-26T00:50:34.698427+0000","last_unstale":"2024-04-26T00:50:40.852840+0000","last_undegraded":"2024-04-26T00:50:40.852840+0000","last_fullsized":"2024-04-26T00:50:40.852840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467285+0000","last_change":"2024-04-26T00:50:39.859688+0000","last_active":"2024-04-26T00:50:41.467285+0000","last_peered":"2024-04-26T00:50:41.467285+0000","last_clean":"2024-04-26T00:50:41.467285+0000","last_became_active":"2024-04-26T00:50:39.859353+0000","last_became_peered":"2024-04-26T00:50:39.859353+0000","last_unstale":"2024-04-26T00:50:41.467285+0000","last_undegraded":"2024-04-26T00:50:41.467285+0000","last_fullsized":"2024-04-26T00:50:41.467285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:18.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468552+0000","last_change":"2024-04-26T00:50:38.876486+0000","last_active":"2024-04-26T00:50:41.468552+0000","last_peered":"2024-04-26T00:50:41.468552+0000","last_clean":"2024-04-26T00:50:41.468552+0000","last_became_active":"2024-04-26T00:50:38.875909+0000","last_became_peered":"2024-04-26T00:50:38.875909+0000","last_unstale":"2024-04-26T00:50:41.468552+0000","last_undegraded":"2024-04-26T00:50:41.468552+0000","last_fullsized":"2024-04-26T00:50:41.468552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:40:21.077132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469439+0000","last_change":"2024-04-26T00:50:34.693570+0000","last_active":"2024-04-26T00:50:41.469439+0000","last_peered":"2024-04-26T00:50:41.469439+0000","last_clean":"2024-04-26T00:50:41.469439+0000","last_became_active":"2024-04-26T00:50:34.692796+0000","last_became_peered":"2024-04-26T00:50:34.692796+0000","last_unstale":"2024-04-26T00:50:41.469439+0000","last_undegraded":"2024-04-26T00:50:41.469439+0000","last_fullsized":"2024-04-26T00:50:41.469439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:31.801975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464450+0000","last_change":"2024-04-26T00:50:39.848704+0000","last_active":"2024-04-26T00:50:41.464450+0000","last_peered":"2024-04-26T00:50:41.464450+0000","last_clean":"2024-04-26T00:50:41.464450+0000","last_became_active":"2024-04-26T00:50:39.848429+0000","last_became_peered":"2024-04-26T00:50:39.848429+0000","last_unstale":"2024-04-26T00:50:41.464450+0000","last_undegraded":"2024-04-26T00:50:41.464450+0000","last_fullsized":"2024-04-26T00:50:41.464450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:40.673273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.837302+0000","last_change":"2024-04-26T00:50:38.867565+0000","last_active":"2024-04-26T00:50:41.837302+0000","last_peered":"2024-04-26T00:50:41.837302+0000","last_clean":"2024-04-26T00:50:41.837302+0000","last_became_active":"2024-04-26T00:50:38.866728+0000","last_became_peered":"2024-04-26T00:50:38.866728+0000","last_unstale":"2024-04-26T00:50:41.837302+0000","last_undegraded":"2024-04-26T00:50:41.837302+0000","last_fullsized":"2024-04-26T00:50:41.837302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:23.691727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852376+0000","last_change":"2024-04-26T00:50:34.693464+0000","last_active":"2024-04-26T00:50:40.852376+0000","last_peered":"2024-04-26T00:50:40.852376+0000","last_clean":"2024-04-26T00:50:40.852376+0000","last_became_active":"2024-04-26T00:50:34.692883+0000","last_became_peered":"2024-04-26T00:50:34.692883+0000","last_unstale":"2024-04-26T00:50:40.852376+0000","last_undegraded":"2024-04-26T00:50:40.852376+0000","last_fullsized":"2024-04-26T00:50:40.852376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:33.666151+0000","last_clean_scrub_stamp":"2024-04-26T00:50:33.666151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:58.555171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854095+0000","last_change":"2024-04-26T00:50:39.856903+0000","last_active":"2024-04-26T00:50:40.854095+0000","last_peered":"2024-04-26T00:50:40.854095+0000","last_clean":"2024-04-26T00:50:40.854095+0000","last_became_active":"2024-04-26T00:50:39.856609+0000","last_became_peered":"2024-04-26T00:50:39.856609+0000","last_unstale":"2024-04-26T00:50:40.854095+0000","last_undegraded":"2024-04-26T00:50:40.854095+0000","last_fullsized":"2024-04-26T00:50:40.854095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:12.129353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854504+0000","last_change":"2024-04-26T00:50:39.857946+0000","last_active":"2024-04-26T00:50:40.854504+0000","last_peered":"2024-04-26T00:50:40.854504+0000","last_clean":"2024-04-26T00:50:40.854504+0000","last_became_active":"2024-04-26T00:50:39.857653+0000","last_became_peered":"2024-04-26T00:50:39.857653+0000","last_unstale":"2024-04-26T00:50:40.854504+0000","last_undegraded":"2024-04-26T00:50:40.854504+0000","last_fullsized":"2024-04-26T00:50:40.854504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:40.181948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851322+0000","last_change":"2024-04-26T00:50:38.846157+0000","last_active":"2024-04-26T00:50:40.851322+0000","last_peered":"2024-04-26T00:50:40.851322+0000","last_clean":"2024-04-26T00:50:40.851322+0000","last_became_active":"2024-04-26T00:50:38.845728+0000","last_became_peered":"2024-04-26T00:50:38.845728+0000","last_unstale":"2024-04-26T00:50:40.851322+0000","last_undegraded":"2024-04-26T00:50:40.851322+0000","last_fullsized":"2024-04-26T00:50:40.851322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465860+0000","last_change":"2024-04-26T00:50:39.851993+0000","last_active":"2024-04-26T00:50:41.465860+0000","last_peered":"2024-04-26T00:50:41.465860+0000","last_clean":"2024-04-26T00:50:41.465860+0000","last_became_active":"2024-04-26T00:50:39.851385+0000","last_became_peered":"2024-04-26T00:50:39.851385+0000","last_unstale":"2024-04-26T00:50:41.465860+0000","last_undegraded":"2024-04-26T00:50:41.465860+0000","last_fullsized":"2024-04-26T00:50:41.465860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855046+0000","last_change":"2024-04-26T00:50:38.859885+0000","last_active":"2024-04-26T00:50:40.855046+0000","last_peered":"2024-04-26T00:50:40.855046+0000","last_clean":"2024-04-26T00:50:40.855046+0000","last_became_active":"2024-04-26T00:50:38.858568+0000","last_became_peered":"2024-04-26T00:50:38.858568+0000","last_unstale":"2024-04-26T00:50:40.855046+0000","last_undegraded":"2024-04-26T00:50:40.855046+0000","last_fullsized":"2024-04-26T00:50:40.855046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.851422+0000","last_change":"2024-04-26T00:50:38.866142+0000","last_active":"2024-04-26T00:50:40.851422+0000","last_peered":"2024-04-26T00:50:40.851422+0000","last_clean":"2024-04-26T00:50:40.851422+0000","last_became_active":"2024-04-26T00:50:38.865557+0000","last_became_peered":"2024-04-26T00:50:38.865557+0000","last_unstale":"2024-04-26T00:50:40.851422+0000","last_undegraded":"2024-04-26T00:50:40.851422+0000","last_fullsized":"2024-04-26T00:50:40.851422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:31.035091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466248+0000","last_change":"2024-04-26T00:50:39.854303+0000","last_active":"2024-04-26T00:50:41.466248+0000","last_peered":"2024-04-26T00:50:41.466248+0000","last_clean":"2024-04-26T00:50:41.466248+0000","last_became_active":"2024-04-26T00:50:39.852216+0000","last_became_peered":"2024-04-26T00:50:39.852216+0000","last_unstale":"2024-04-26T00:50:41.466248+0000","last_undegraded":"2024-04-26T00:50:41.466248+0000","last_fullsized":"2024-04-26T00:50:41.466248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:44:36.469101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469542+0000","last_change":"2024-04-26T00:50:38.867859+0000","last_active":"2024-04-26T00:50:41.469542+0000","last_peered":"2024-04-26T00:50:41.469542+0000","last_clean":"2024-04-26T00:50:41.469542+0000","last_became_active":"2024-04-26T00:50:38.866771+0000","last_became_peered":"2024-04-26T00:50:38.866771+0000","last_unstale":"2024-04-26T00:50:41.469542+0000","last_undegraded":"2024-04-26T00:50:41.469542+0000","last_fullsized":"2024-04-26T00:50:41.469542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:06.841571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464008+0000","last_change":"2024-04-26T00:50:39.851991+0000","last_active":"2024-04-26T00:50:41.464008+0000","last_peered":"2024-04-26T00:50:41.464008+0000","last_clean":"2024-04-26T00:50:41.464008+0000","last_became_active":"2024-04-26T00:50:39.851680+0000","last_became_peered":"2024-04-26T00:50:39.851680+0000","last_unstale":"2024-04-26T00:50:41.464008+0000","last_undegraded":"2024-04-26T00:50:41.464008+0000","last_fullsized":"2024-04-26T00:50:41.464008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:51.385973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852269+0000","last_change":"2024-04-26T00:50:39.859275+0000","last_active":"2024-04-26T00:50:40.852269+0000","last_peered":"2024-04-26T00:50:40.852269+0000","last_clean":"2024-04-26T00:50:40.852269+0000","last_became_active":"2024-04-26T00:50:39.858722+0000","last_became_peered":"2024-04-26T00:50:39.858722+0000","last_unstale":"2024-04-26T00:50:40.852269+0000","last_undegraded":"2024-04-26T00:50:40.852269+0000","last_fullsized":"2024-04-26T00:50:40.852269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:43.277704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.464709+0000","last_change":"2024-04-26T00:50:38.876692+0000","last_active":"2024-04-26T00:50:41.464709+0000","last_peered":"2024-04-26T00:50:41.464709+0000","last_clean":"2024-04-26T00:50:41.464709+0000","last_became_active":"2024-04-26T00:50:38.875789+0000","last_became_peered":"2024-04-26T00:50:38.875789+0000","last_unstale":"2024-04-26T00:50:41.464709+0000","last_undegraded":"2024-04-26T00:50:41.464709+0000","last_fullsized":"2024-04-26T00:50:41.464709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:57.272338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.468966+0000","last_change":"2024-04-26T00:50:39.853149+0000","last_active":"2024-04-26T00:50:41.468966+0000","last_peered":"2024-04-26T00:50:41.468966+0000","last_clean":"2024-04-26T00:50:41.468966+0000","last_became_active":"2024-04-26T00:50:39.852980+0000","last_became_peered":"2024-04-26T00:50:39.852980+0000","last_unstale":"2024-04-26T00:50:41.468966+0000","last_undegraded":"2024-04-26T00:50:41.468966+0000","last_fullsized":"2024-04-26T00:50:41.468966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.465368+0000","last_change":"2024-04-26T00:50:38.868567+0000","last_active":"2024-04-26T00:50:41.465368+0000","last_peered":"2024-04-26T00:50:41.465368+0000","last_clean":"2024-04-26T00:50:41.465368+0000","last_became_active":"2024-04-26T00:50:38.867948+0000","last_became_peered":"2024-04-26T00:50:38.867948+0000","last_unstale":"2024-04-26T00:50:41.465368+0000","last_undegraded":"2024-04-26T00:50:41.465368+0000","last_fullsized":"2024-04-26T00:50:41.465368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:11.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466691+0000","last_change":"2024-04-26T00:50:39.860208+0000","last_active":"2024-04-26T00:50:41.466691+0000","last_peered":"2024-04-26T00:50:41.466691+0000","last_clean":"2024-04-26T00:50:41.466691+0000","last_became_active":"2024-04-26T00:50:39.859876+0000","last_became_peered":"2024-04-26T00:50:39.859876+0000","last_unstale":"2024-04-26T00:50:41.466691+0000","last_undegraded":"2024-04-26T00:50:41.466691+0000","last_fullsized":"2024-04-26T00:50:41.466691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:02.488113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850749+0000","last_change":"2024-04-26T00:50:38.866484+0000","last_active":"2024-04-26T00:50:40.850749+0000","last_peered":"2024-04-26T00:50:40.850749+0000","last_clean":"2024-04-26T00:50:40.850749+0000","last_became_active":"2024-04-26T00:50:38.865840+0000","last_became_peered":"2024-04-26T00:50:38.865840+0000","last_unstale":"2024-04-26T00:50:40.850749+0000","last_undegraded":"2024-04-26T00:50:40.850749+0000","last_fullsized":"2024-04-26T00:50:40.850749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:37.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.855141+0000","last_change":"2024-04-26T00:50:39.866945+0000","last_active":"2024-04-26T00:50:40.855141+0000","last_peered":"2024-04-26T00:50:40.855141+0000","last_clean":"2024-04-26T00:50:40.855141+0000","last_became_active":"2024-04-26T00:50:39.866257+0000","last_became_peered":"2024-04-26T00:50:39.866257+0000","last_unstale":"2024-04-26T00:50:40.855141+0000","last_undegraded":"2024-04-26T00:50:40.855141+0000","last_fullsized":"2024-04-26T00:50:40.855141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:07.845148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.466077+0000","last_change":"2024-04-26T00:50:38.870006+0000","last_active":"2024-04-26T00:50:41.466077+0000","last_peered":"2024-04-26T00:50:41.466077+0000","last_clean":"2024-04-26T00:50:41.466077+0000","last_became_active":"2024-04-26T00:50:38.869408+0000","last_became_peered":"2024-04-26T00:50:38.869408+0000","last_unstale":"2024-04-26T00:50:41.466077+0000","last_undegraded":"2024-04-26T00:50:41.466077+0000","last_fullsized":"2024-04-26T00:50:41.466077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:20.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.854580+0000","last_change":"2024-04-26T00:50:39.867012+0000","last_active":"2024-04-26T00:50:40.854580+0000","last_peered":"2024-04-26T00:50:40.854580+0000","last_clean":"2024-04-26T00:50:40.854580+0000","last_became_active":"2024-04-26T00:50:39.866002+0000","last_became_peered":"2024-04-26T00:50:39.866002+0000","last_unstale":"2024-04-26T00:50:40.854580+0000","last_undegraded":"2024-04-26T00:50:40.854580+0000","last_fullsized":"2024-04-26T00:50:40.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:38.297542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467910+0000","last_change":"2024-04-26T00:50:38.868711+0000","last_active":"2024-04-26T00:50:41.467910+0000","last_peered":"2024-04-26T00:50:41.467910+0000","last_clean":"2024-04-26T00:50:41.467910+0000","last_became_active":"2024-04-26T00:50:38.868002+0000","last_became_peered":"2024-04-26T00:50:38.868002+0000","last_unstale":"2024-04-26T00:50:41.467910+0000","last_undegraded":"2024-04-26T00:50:41.467910+0000","last_fullsized":"2024-04-26T00:50:41.467910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:39.178372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.850433+0000","last_change":"2024-04-26T00:50:39.857039+0000","last_active":"2024-04-26T00:50:40.850433+0000","last_peered":"2024-04-26T00:50:40.850433+0000","last_clean":"2024-04-26T00:50:40.850433+0000","last_became_active":"2024-04-26T00:50:39.856666+0000","last_became_peered":"2024-04-26T00:50:39.856666+0000","last_unstale":"2024-04-26T00:50:40.850433+0000","last_undegraded":"2024-04-26T00:50:40.850433+0000","last_fullsized":"2024-04-26T00:50:40.850433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:50:41.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.852110+0000","last_change":"2024-04-26T00:50:38.849900+0000","last_active":"2024-04-26T00:50:40.852110+0000","last_peered":"2024-04-26T00:50:40.852110+0000","last_clean":"2024-04-26T00:50:40.852110+0000","last_became_active":"2024-04-26T00:50:38.849354+0000","last_became_peered":"2024-04-26T00:50:38.849354+0000","last_unstale":"2024-04-26T00:50:40.852110+0000","last_undegraded":"2024-04-26T00:50:40.852110+0000","last_fullsized":"2024-04-26T00:50:40.852110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:38.438162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467384+0000","last_change":"2024-04-26T00:50:39.863655+0000","last_active":"2024-04-26T00:50:41.467384+0000","last_peered":"2024-04-26T00:50:41.467384+0000","last_clean":"2024-04-26T00:50:41.467384+0000","last_became_active":"2024-04-26T00:50:39.863378+0000","last_became_peered":"2024-04-26T00:50:39.863378+0000","last_unstale":"2024-04-26T00:50:41.467384+0000","last_undegraded":"2024-04-26T00:50:41.467384+0000","last_fullsized":"2024-04-26T00:50:41.467384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:04.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.467256+0000","last_change":"2024-04-26T00:50:38.876385+0000","last_active":"2024-04-26T00:50:41.467256+0000","last_peered":"2024-04-26T00:50:41.467256+0000","last_clean":"2024-04-26T00:50:41.467256+0000","last_became_active":"2024-04-26T00:50:38.875458+0000","last_became_peered":"2024-04-26T00:50:38.875458+0000","last_unstale":"2024-04-26T00:50:41.467256+0000","last_undegraded":"2024-04-26T00:50:41.467256+0000","last_fullsized":"2024-04-26T00:50:41.467256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:45.132283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:40.849703+0000","last_change":"2024-04-26T00:50:39.847368+0000","last_active":"2024-04-26T00:50:40.849703+0000","last_peered":"2024-04-26T00:50:40.849703+0000","last_clean":"2024-04-26T00:50:40.849703+0000","last_became_active":"2024-04-26T00:50:39.845961+0000","last_became_peered":"2024-04-26T00:50:39.845961+0000","last_unstale":"2024-04-26T00:50:40.849703+0000","last_undegraded":"2024-04-26T00:50:40.849703+0000","last_fullsized":"2024-04-26T00:50:40.849703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:38.811523+0000","last_clean_scrub_stamp":"2024-04-26T00:50:38.811523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:48.088404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T00:50:41.469540+0000","last_change":"2024-04-26T00:50:38.873696+0000","last_active":"2024-04-26T00:50:41.469540+0000","last_peered":"2024-04-26T00:50:41.469540+0000","last_clean":"2024-04-26T00:50:41.469540+0000","last_became_active":"2024-04-26T00:50:38.873136+0000","last_became_peered":"2024-04-26T00:50:38.873136+0000","last_unstale":"2024-04-26T00:50:41.469540+0000","last_undegraded":"2024-04-26T00:50:41.469540+0000","last_fullsized":"2024-04-26T00:50:41.469540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:50:37.807947+0000","last_clean_scrub_stamp":"2024-04-26T00:50:37.807947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:03:19.993664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705673,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":656236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":654556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:50:52.316 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T00:50:52.316 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T00:50:52.316 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T00:50:52.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T00:50:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 Processor -- start 2024-04-26T00:50:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 -- start start 2024-04-26T00:50:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4d8070170 0x7fe4d8148610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d80a7260 con 0x7fe4d8144650 2024-04-26T00:50:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d8148ed0 con 0x7fe4d8144ac0 2024-04-26T00:50:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4e02d0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d8144ed0 con 0x7fe4d8070170 2024-04-26T00:50:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4de06c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4d8070170 0x7fe4d8148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4de06c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4d8070170 0x7fe4d8148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37570/0 (socket says 172.21.15.6:37570) 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.464+0000 7fe4de06c640 1 -- 172.21.15.6:0/2191398579 learned_addr learned my addr 172.21.15.6:0/2191398579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4de06c640 1 -- 172.21.15.6:0/2191398579 >> v1:172.21.15.188:6789/0 conn(0x7fe4d8144ac0 legacy=0x7fe4d80a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4de06c640 1 -- 172.21.15.6:0/2191398579 >> v1:172.21.15.6:6789/0 conn(0x7fe4d8144650 legacy=0x7fe4d80a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4de06c640 1 -- 172.21.15.6:0/2191398579 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d8149190 con 0x7fe4d8070170 2024-04-26T00:50:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4dd06a640 1 -- 172.21.15.6:0/2191398579 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350838258 0 0) 0x7fe4d80a7260 con 0x7fe4d8144650 2024-04-26T00:50:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4de06c640 1 --2- 172.21.15.6:0/2191398579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d8148610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009e50 tx=0x7fe4d401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebad4831cc12a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4dd06a640 1 -- 172.21.15.6:0/2191398579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40a5710 con 0x7fe4d8070170 2024-04-26T00:50:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4dd06a640 1 -- 172.21.15.6:0/2191398579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d40a58b0 con 0x7fe4d8070170 2024-04-26T00:50:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4dd06a640 1 -- 172.21.15.6:0/2191398579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40a5c80 con 0x7fe4d8070170 2024-04-26T00:50:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2191398579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 msgr2=0x7fe4d8148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2191398579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d8148610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009e50 tx=0x7fe4d401c940 comp rx=0 tx=0).stop 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2191398579 shutdown_connections 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2191398579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d8148610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2191398579 >> 172.21.15.6:0/2191398579 conn(0x7fe4d806e230 msgr2=0x7fe4d80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2191398579 shutdown_connections 2024-04-26T00:50:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.468+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2191398579 wait complete. 2024-04-26T00:50:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 Processor -- start 2024-04-26T00:50:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- start start 2024-04-26T00:50:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d8144650 0x7fe4d8139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 0x7fe4d813a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d80b78a0 con 0x7fe4d8070170 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d80b7720 con 0x7fe4d8144650 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d80712d0 con 0x7fe4d8144ac0 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37572/0 (socket says 172.21.15.6:37572) 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 -- 172.21.15.6:0/2263009085 learned_addr learned my addr 172.21.15.6:0/2263009085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de86d640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 0x7fe4d813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 -- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 msgr2=0x7fe4d813a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 0x7fe4d813a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 -- 172.21.15.6:0/2263009085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d8144650 msgr2=0x7fe4d8139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4dd86b640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d8144650 0x7fe4d8139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d8144650 0x7fe4d8139b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 -- 172.21.15.6:0/2263009085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d813a7e0 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de86d640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 0x7fe4d813a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4de06c640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40af040 tx=0x7fe4d40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003ba0 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4003d40 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d813aaa0 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4004230 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d8138b30 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d806db70 con 0x7fe4d8070170 2024-04-26T00:50:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fe4d40043d0 con 0x7fe4d8070170 2024-04-26T00:50:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.472+0000 7fe4ceffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 0x7fe4bc09b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4dd86b640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 0x7fe4bc09b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fe4d415e410 con 0x7fe4d8070170 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4dd86b640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 0x7fe4bc09b830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8151990 tx=0x7fe4c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.476+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe4d40c7020 con 0x7fe4d8070170 2024-04-26T00:50:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4d80b5b00 con 0x7fe4d8070170 2024-04-26T00:50:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4ceffd640 1 -- 172.21.15.6:0/2263009085 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe4d40165c0 con 0x7fe4d8070170 2024-04-26T00:50:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:52.676 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 10 mgrc shutdown 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 msgr2=0x7fe4bc09b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 0x7fe4bc09b830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8151990 tx=0x7fe4c8009040 comp rx=0 tx=0).stop 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 msgr2=0x7fe4d81392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40af040 tx=0x7fe4d40196e0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 shutdown_connections 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe4bc099370 0x7fe4bc09b830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d8144ac0 0x7fe4d813a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4d8144650 0x7fe4d8139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 --2- 172.21.15.6:0/2263009085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d8070170 0x7fe4d81392b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 >> 172.21.15.6:0/2263009085 conn(0x7fe4d806e230 msgr2=0x7fe4d8072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 shutdown_connections 2024-04-26T00:50:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.668+0000 7fe4e02d0640 1 -- 172.21.15.6:0/2263009085 wait complete. 2024-04-26T00:50:52.693 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T00:50:52.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 Processor -- start 2024-04-26T00:50:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 -- start start 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f50c80a3480 0x7f50c814b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c814bab0 0x7f50c814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c8147130 con 0x7f50c8146d50 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f50c80b3d10 con 0x7f50c814bab0 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50ce86e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f50c806b510 con 0x7f50c80a3480 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c814bab0 0x7f50c814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c814bab0 0x7f50c814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37580/0 (socket says 172.21.15.6:37580) 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 -- 172.21.15.6:0/2079243599 learned_addr learned my addr 172.21.15.6:0/2079243599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50c77fe640 1 --2- 172.21.15.6:0/2079243599 >> v2:172.21.15.188:3300/0 conn(0x7f50c80a3480 0x7f50c814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 -- 172.21.15.6:0/2079243599 >> v2:172.21.15.188:3300/0 conn(0x7f50c80a3480 msgr2=0x7f50c814b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 --2- 172.21.15.6:0/2079243599 >> v2:172.21.15.188:3300/0 conn(0x7f50c80a3480 0x7f50c814b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 -- 172.21.15.6:0/2079243599 >> v1:172.21.15.188:6789/0 conn(0x7f50c8146d50 legacy=0x7f50c80a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 -- 172.21.15.6:0/2079243599 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c80a3be0 con 0x7f50c814bab0 2024-04-26T00:50:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50cce0b640 1 --2- 172.21.15.6:0/2079243599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c814dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50c806b690 tx=0x7f50c001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d328dffe74736427 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50c6ffd640 1 -- 172.21.15.6:0/2079243599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a5640 con 0x7f50c814bab0 2024-04-26T00:50:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50c6ffd640 1 -- 172.21.15.6:0/2079243599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c00a57e0 con 0x7f50c814bab0 2024-04-26T00:50:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.804+0000 7f50c6ffd640 1 -- 172.21.15.6:0/2079243599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a5bb0 con 0x7f50c814bab0 2024-04-26T00:50:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/2079243599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 msgr2=0x7f50c814dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- 172.21.15.6:0/2079243599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c814dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50c806b690 tx=0x7f50c001c870 comp rx=0 tx=0).stop 2024-04-26T00:50:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/2079243599 shutdown_connections 2024-04-26T00:50:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- 172.21.15.6:0/2079243599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c814dea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- 172.21.15.6:0/2079243599 >> v2:172.21.15.188:3300/0 conn(0x7f50c80a3480 0x7f50c814b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/2079243599 >> 172.21.15.6:0/2079243599 conn(0x7f50c80b71a0 msgr2=0x7f50c80b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/2079243599 shutdown_connections 2024-04-26T00:50:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/2079243599 wait complete. 2024-04-26T00:50:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 Processor -- start 2024-04-26T00:50:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- start start 2024-04-26T00:50:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 0x7f50c80a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50c8146d50 0x7f50c813dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806b9a0 con 0x7f50c814bab0 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806b1a0 con 0x7f50c8146d50 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f50c81e1960 con 0x7f50c80a3480 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50cce0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 0x7f50c80a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50cce0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37596/0 (socket says 172.21.15.6:37596) 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50cce0b640 1 -- 172.21.15.6:0/23028623 learned_addr learned my addr 172.21.15.6:0/23028623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 -- 172.21.15.6:0/23028623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50c8146d50 msgr2=0x7f50c813dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c77fe640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50c8146d50 0x7f50c813dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50c8146d50 0x7f50c813dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 -- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 msgr2=0x7f50c81e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 -- 172.21.15.6:0/23028623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81e1c20 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50cce0b640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c7fff640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 0x7f50c80a21e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c410 tx=0x7f50b800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8017070 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b80069e0 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8006e10 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c80b6ba0 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.808+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c80a2720 con 0x7f50c80a3480 2024-04-26T00:50:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c806db70 con 0x7f50c80a3480 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f50b801a070 con 0x7f50c80a3480 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 0x7f50b409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f50b80c1720 con 0x7f50c80a3480 2024-04-26T00:50:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c77fe640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 0x7f50b409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.812+0000 7f50c77fe640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 0x7f50b409b800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50c8139cb0 tx=0x7f50bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.816+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f50b80926b0 con 0x7f50c80a3480 2024-04-26T00:50:52.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.976+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50c813dbd0 con 0x7f50c80a3480 2024-04-26T00:50:52.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.976+0000 7f50c4ff9640 1 -- 172.21.15.6:0/23028623 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7f50b8091fb0 con 0x7f50c80a3480 2024-04-26T00:50:52.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:52.986 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:52.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 10 mgrc shutdown 2024-04-26T00:50:52.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 msgr2=0x7f50b409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 0x7f50b409b800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50c8139cb0 tx=0x7f50bc008040 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 msgr2=0x7f50c80a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 0x7f50c80a21e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c410 tx=0x7f50b800c8d0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 shutdown_connections 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f50b4099340 0x7f50b409b800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c814bab0 0x7f50c81e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50c8146d50 0x7f50c813dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 --2- 172.21.15.6:0/23028623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f50c80a3480 0x7f50c80a21e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 >> 172.21.15.6:0/23028623 conn(0x7f50c80b71a0 msgr2=0x7f50c80a5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 shutdown_connections 2024-04-26T00:50:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:52.980+0000 7f50ce86e640 1 -- 172.21.15.6:0/23028623 wait complete. 2024-04-26T00:50:53.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T00:50:28.326359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T00:50:33.296137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T00:50:37.659451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T00:50:38.192325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T00:50:53.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T00:50:53.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 Processor -- start 2024-04-26T00:50:53.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 -- start start 2024-04-26T00:50:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 0x7f4af4143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 0x7f4af40ab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af41464c0 con 0x7f4af4071cf0 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4af40720d0 con 0x7f4af4143110 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af8b55640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f4af4146260 con 0x7f4af40aafb0 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 0x7f4af40ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4af4071cf0 0x7f4af406c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57014/0 (socket says 172.21.15.6:57014) 2024-04-26T00:50:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af259c640 1 -- 172.21.15.6:0/4221505951 learned_addr learned my addr 172.21.15.6:0/4221505951 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af1d9b640 1 --2- 172.21.15.6:0/4221505951 >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 0x7f4af4143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af2d9d640 1 -- 172.21.15.6:0/4221505951 >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 msgr2=0x7f4af4143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af2d9d640 1 --2- 172.21.15.6:0/4221505951 >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 0x7f4af4143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af2d9d640 1 -- 172.21.15.6:0/4221505951 >> v1:172.21.15.6:6789/0 conn(0x7f4af4071cf0 legacy=0x7f4af406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af2d9d640 1 -- 172.21.15.6:0/4221505951 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af4143a60 con 0x7f4af40aafb0 2024-04-26T00:50:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.112+0000 7f4af1d9b640 1 --2- 172.21.15.6:0/4221505951 >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 0x7f4af4143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:53.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af2d9d640 1 --2- 172.21.15.6:0/4221505951 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 0x7f4af40ab420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d90 tx=0x7f4aec01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eca1765f064a8c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af159a640 1 -- 172.21.15.6:0/4221505951 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0b2070 con 0x7f4af40aafb0 2024-04-26T00:50:53.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af159a640 1 -- 172.21.15.6:0/4221505951 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec0a5800 con 0x7f4af40aafb0 2024-04-26T00:50:53.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af159a640 1 -- 172.21.15.6:0/4221505951 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0a5bd0 con 0x7f4af40aafb0 2024-04-26T00:50:53.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- 172.21.15.6:0/4221505951 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 msgr2=0x7f4af40ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 --2- 172.21.15.6:0/4221505951 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 0x7f4af40ab420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d90 tx=0x7f4aec01c830 comp rx=0 tx=0).stop 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- 172.21.15.6:0/4221505951 shutdown_connections 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 --2- 172.21.15.6:0/4221505951 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af40aafb0 0x7f4af40ab420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 --2- 172.21.15.6:0/4221505951 >> v2:172.21.15.6:3300/0 conn(0x7f4af4143110 0x7f4af4143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- 172.21.15.6:0/4221505951 >> 172.21.15.6:0/4221505951 conn(0x7f4af40b70c0 msgr2=0x7f4af40b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- 172.21.15.6:0/4221505951 shutdown_connections 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- 172.21.15.6:0/4221505951 wait complete. 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 Processor -- start 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.116+0000 7f4af8b55640 1 -- start start 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af4071cf0 0x7f4af4147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 0x7f4af4139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4150100 con 0x7f4af40aafb0 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4af414ff80 con 0x7f4af4071cf0 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f4af4150280 con 0x7f4af4143110 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 0x7f4af4139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60896/0 (socket says 172.21.15.6:60896) 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af2d9d640 1 -- 172.21.15.6:0/400164863 learned_addr learned my addr 172.21.15.6:0/400164863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 -- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 msgr2=0x7f4af41399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af259c640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af4071cf0 0x7f4af4147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 -- 172.21.15.6:0/400164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af4071cf0 msgr2=0x7f4af4147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af4071cf0 0x7f4af4147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 -- 172.21.15.6:0/400164863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af4134cc0 con 0x7f4af40aafb0 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af2d9d640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af1d9b640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 0x7f4af4139490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800e910 tx=0x7f4ae800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8017070 con 0x7f4af40aafb0 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae800c9a0 con 0x7f4af40aafb0 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af4140800 con 0x7f4af40aafb0 2024-04-26T00:50:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae800cd90 con 0x7f4af40aafb0 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af4140050 con 0x7f4af40aafb0 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af406db70 con 0x7f4af40aafb0 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f4ae801a070 con 0x7f4af40aafb0 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 0x7f4ad409b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f4ae80c28b0 con 0x7f4af40aafb0 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.120+0000 7f4af259c640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 0x7f4ad409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.124+0000 7f4af259c640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 0x7f4ad409b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000f70 tx=0x7f4ae4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.124+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4ae8093840 con 0x7f4af40aafb0 2024-04-26T00:50:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4af40b78f0 con 0x7f4af40aafb0 2024-04-26T00:50:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4ae2ffd640 1 -- 172.21.15.6:0/400164863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4ae8093140 con 0x7f4af40aafb0 2024-04-26T00:50:53.288 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-04-26T00:50:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 10 mgrc shutdown 2024-04-26T00:50:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 msgr2=0x7f4ad409b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 0x7f4ad409b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000f70 tx=0x7f4ae4009040 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 msgr2=0x7f4af4139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 0x7f4af4139490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800e910 tx=0x7f4ae800edd0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 shutdown_connections 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f4ad40992c0 0x7f4ad409b780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af4143110 0x7f4af41399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af40aafb0 0x7f4af4139490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 --2- 172.21.15.6:0/400164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af4071cf0 0x7f4af4147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 >> 172.21.15.6:0/400164863 conn(0x7f4af40b70c0 msgr2=0x7f4af406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 shutdown_connections 2024-04-26T00:50:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.280+0000 7f4af8b55640 1 -- 172.21.15.6:0/400164863 wait complete. 2024-04-26T00:50:53.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T00:50:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 Processor -- start 2024-04-26T00:50:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 -- start start 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f81b00aa410 0x7f81b014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b00a8120 con 0x7f81b00a5a90 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b00aaa90 con 0x7f81b0072910 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b7638640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f81b0071310 con 0x7f81b00aa410 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81b00a5a90 0x7f81b00b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57020/0 (socket says 172.21.15.6:57020) 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 -- 172.21.15.6:0/561085483 learned_addr learned my addr 172.21.15.6:0/561085483 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b5bd5640 1 --2- 172.21.15.6:0/561085483 >> v2:172.21.15.188:3300/0 conn(0x7f81b00aa410 0x7f81b014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010278146 0 0) 0x7f81b00a8120 con 0x7f81b00a5a90 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819c003530 con 0x7f81b00a5a90 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2423449861 0 0) 0x7f819c003530 con 0x7f81b00a5a90 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 >> v2:172.21.15.188:3300/0 conn(0x7f81b00aa410 msgr2=0x7f81b014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 --2- 172.21.15.6:0/561085483 >> v2:172.21.15.188:3300/0 conn(0x7f81b00aa410 0x7f81b014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 >> v1:172.21.15.188:6789/0 conn(0x7f81b0072910 legacy=0x7f81b014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b0071540 con 0x7f81b00a5a90 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 297429848 0 0) 0x7f81a4001680 con 0x7f81b00a5a90 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 >> v1:172.21.15.6:6789/0 conn(0x7f81b00a5a90 legacy=0x7f81b00b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 0x7f819c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f819c004810 0x7f819c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c005240 0x7f819c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f819c00c170 con 0x7f819c005240 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f819c00c320 con 0x7f819c004810 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f819c00c520 con 0x7f819c003a30 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 0x7f819c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b5bd5640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c005240 0x7f819c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b4bd3640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f819c004810 0x7f819c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 -- 172.21.15.6:0/561085483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f819c004810 msgr2=0x7f819c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f819c004810 0x7f819c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 -- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c005240 msgr2=0x7f819c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c005240 0x7f819c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b53d4640 1 -- 172.21.15.6:0/561085483 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c003530 con 0x7f819c003a30 2024-04-26T00:50:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.412+0000 7f81b5bd5640 1 -- 172.21.15.6:0/561085483 reap_dead start 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b53d4640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 0x7f819c003e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c210 tx=0x7f81a401f290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7440e1a4ce3a6830 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4007d40 con 0x7f819c003a30 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a40ac070 con 0x7f819c003a30 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81a3fff640 1 -- 172.21.15.6:0/561085483 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4005b20 con 0x7f819c003a30 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 msgr2=0x7f819c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 0x7f819c003e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c210 tx=0x7f81a401f290 comp rx=0 tx=0).stop 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- 172.21.15.6:0/561085483 shutdown_connections 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 --2- 172.21.15.6:0/561085483 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f819c003a30 0x7f819c003e50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- 172.21.15.6:0/561085483 >> 172.21.15.6:0/561085483 conn(0x7f81b006e7b0 msgr2=0x7f81b00b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- 172.21.15.6:0/561085483 shutdown_connections 2024-04-26T00:50:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- 172.21.15.6:0/561085483 wait complete. 2024-04-26T00:50:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 Processor -- start 2024-04-26T00:50:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.416+0000 7f81b7638640 1 -- start start 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c003a30 0x7f81b0145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81b01ce120 0x7f81b01ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81b00737a0 con 0x7f819c003a30 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0072fc0 con 0x7f81b01ce120 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00a5e70 con 0x7f81b00a04a0 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60912/0 (socket says 172.21.15.6:60912) 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 -- 172.21.15.6:0/774646621 learned_addr learned my addr 172.21.15.6:0/774646621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b53d4640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c003a30 0x7f81b0145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 -- 172.21.15.6:0/774646621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81b01ce120 msgr2=0x7f81b01ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81b01ce120 0x7f81b01ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 -- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c003a30 msgr2=0x7f81b0145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c003a30 0x7f81b0145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 -- 172.21.15.6:0/774646621 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00a1470 con 0x7f81b00a04a0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b4bd3640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e7e0 tx=0x7f81ac00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac019070 con 0x7f81b00a04a0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac00ee90 con 0x7f81b00a04a0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b00a1710 con 0x7f81b00a04a0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac003980 con 0x7f81b00a04a0 2024-04-26T00:50:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01466b0 con 0x7f81b00a04a0 2024-04-26T00:50:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b006db70 con 0x7f81b00a04a0 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f81ac01c070 con 0x7f81b00a04a0 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 0x7f819409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81b53d4640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 0x7f819409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.420+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f81ac0c1980 con 0x7f81b00a04a0 2024-04-26T00:50:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.424+0000 7f81b53d4640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 0x7f819409b800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ae000 tx=0x7f81a40aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.424+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f81ac0922c0 con 0x7f81b00a04a0 2024-04-26T00:50:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.580+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f81b0072d00 con 0x7f81b00a04a0 2024-04-26T00:50:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.580+0000 7f81a1ffb640 1 -- 172.21.15.6:0/774646621 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (secure 0 0 0) 0x7f81ac0965c0 con 0x7f81b00a04a0 2024-04-26T00:50:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2024-04-26T00:50:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 10 mgrc shutdown 2024-04-26T00:50:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 msgr2=0x7f819409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 0x7f819409b800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ae000 tx=0x7f81a40aa070 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 msgr2=0x7f81b00a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e7e0 tx=0x7f81ac00eca0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 shutdown_connections 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f8194099340 0x7f819409b800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81b01ce120 0x7f81b01ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81b00a04a0 0x7f81b00a08a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 --2- 172.21.15.6:0/774646621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f819c003a30 0x7f81b0145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 >> 172.21.15.6:0/774646621 conn(0x7f81b006e7b0 msgr2=0x7f81b006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 shutdown_connections 2024-04-26T00:50:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.584+0000 7f81b7638640 1 -- 172.21.15.6:0/774646621 wait complete. 2024-04-26T00:50:53.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T00:50:53.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 Processor -- start 2024-04-26T00:50:53.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 -- start start 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f989c0aab00 0x7f989c0a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c143040 con 0x7f989c143810 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f989c143bf0 con 0x7f989c0aab00 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a258f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f989c143300 con 0x7f989c0aaf20 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60914/0 (socket says 172.21.15.6:60914) 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 -- 172.21.15.6:0/343260120 learned_addr learned my addr 172.21.15.6:0/343260120 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f989b7fe640 1 --2- 172.21.15.6:0/343260120 >> v2:172.21.15.6:3300/0 conn(0x7f989c0aab00 0x7f989c0a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 -- 172.21.15.6:0/343260120 >> v2:172.21.15.6:3300/0 conn(0x7f989c0aab00 msgr2=0x7f989c0a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 --2- 172.21.15.6:0/343260120 >> v2:172.21.15.6:3300/0 conn(0x7f989c0aab00 0x7f989c0a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 -- 172.21.15.6:0/343260120 >> v1:172.21.15.188:6789/0 conn(0x7f989c143810 legacy=0x7f989c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.728+0000 7f98a0b2c640 1 -- 172.21.15.6:0/343260120 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c06c570 con 0x7f989c0aaf20 2024-04-26T00:50:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a0b2c640 1 --2- 172.21.15.6:0/343260120 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9894009e50 tx=0x7f989401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3039dcd88cbd54d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989affd640 1 -- 172.21.15.6:0/343260120 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940a5860 con 0x7f989c0aaf20 2024-04-26T00:50:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989affd640 1 -- 172.21.15.6:0/343260120 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98940a5a00 con 0x7f989c0aaf20 2024-04-26T00:50:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989affd640 1 -- 172.21.15.6:0/343260120 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940a5dd0 con 0x7f989c0aaf20 2024-04-26T00:50:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- 172.21.15.6:0/343260120 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 msgr2=0x7f989c0a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- 172.21.15.6:0/343260120 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9894009e50 tx=0x7f989401c980 comp rx=0 tx=0).stop 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- 172.21.15.6:0/343260120 shutdown_connections 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- 172.21.15.6:0/343260120 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aaf20 0x7f989c0a97c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- 172.21.15.6:0/343260120 >> v2:172.21.15.6:3300/0 conn(0x7f989c0aab00 0x7f989c0a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- 172.21.15.6:0/343260120 >> 172.21.15.6:0/343260120 conn(0x7f989c0707c0 msgr2=0x7f989c0b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- 172.21.15.6:0/343260120 shutdown_connections 2024-04-26T00:50:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- 172.21.15.6:0/343260120 wait complete. 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 Processor -- start 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- start start 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 0x7f989c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 0x7f989c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1501a0 con 0x7f989c143810 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f989c150020 con 0x7f989c0aaf20 2024-04-26T00:50:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a258f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f989c150320 con 0x7f989c0aab00 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a0b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 0x7f989c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60918/0 (socket says 172.21.15.6:60918) 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 -- 172.21.15.6:0/2272241988 learned_addr learned my addr 172.21.15.6:0/2272241988 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989b7fe640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 0x7f989c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 -- 172.21.15.6:0/2272241988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 msgr2=0x7f989c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 0x7f989c146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 -- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 msgr2=0x7f989c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 0x7f989c147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989bfff640 1 -- 172.21.15.6:0/2272241988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c149ce0 con 0x7f989c0aab00 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f989b7fe640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 0x7f989c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.732+0000 7f98a0b2c640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 0x7f989c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f989bfff640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c450 tx=0x7f988c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c016020 con 0x7f989c0aab00 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c0052d0 con 0x7f989c0aab00 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c149540 con 0x7f989c0aab00 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c007260 con 0x7f989c0aab00 2024-04-26T00:50:53.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c148770 con 0x7f989c0aab00 2024-04-26T00:50:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c06db70 con 0x7f989c0aab00 2024-04-26T00:50:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f988c007400 con 0x7f989c0aab00 2024-04-26T00:50:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:53.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 0x7f988809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f989b7fe640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 0x7f988809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f988c0c2a20 con 0x7f989c0aab00 2024-04-26T00:50:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.736+0000 7f989b7fe640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 0x7f988809b800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f989c1472f0 tx=0x7f9890008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:53.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.740+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f988c020020 con 0x7f989c0aab00 2024-04-26T00:50:53.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.908+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f989c147a10 con 0x7f989c0aab00 2024-04-26T00:50:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.908+0000 7f9898ff9640 1 -- 172.21.15.6:0/2272241988 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f989c149ce0 con 0x7f989c0aab00 2024-04-26T00:50:53.918 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-04-26T00:50:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 10 mgrc shutdown 2024-04-26T00:50:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 msgr2=0x7f988809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 0x7f988809b800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f989c1472f0 tx=0x7f9890008040 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 msgr2=0x7f989c148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c450 tx=0x7f988c00c910 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 shutdown_connections 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f9888099340 0x7f988809b800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989c143810 0x7f989c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c0aaf20 0x7f989c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 --2- 172.21.15.6:0/2272241988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f989c0aab00 0x7f989c148f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 >> 172.21.15.6:0/2272241988 conn(0x7f989c0707c0 msgr2=0x7f989c0a5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 shutdown_connections 2024-04-26T00:50:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:53.912+0000 7f98a258f640 1 -- 172.21.15.6:0/2272241988 wait complete. 2024-04-26T00:50:53.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T00:50:54.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 Processor -- start 2024-04-26T00:50:54.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 -- start start 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f752c138340 0x7f752c0a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f752c1375d0 con 0x7f752c0a6f40 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f752c0b3420 con 0x7f752c138340 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f7531934640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f752c0a4910 con 0x7f752c06c680 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60922/0 (socket says 172.21.15.6:60922) 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 -- 172.21.15.6:0/3634579384 learned_addr learned my addr 172.21.15.6:0/3634579384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752affd640 1 --2- 172.21.15.6:0/3634579384 >> v2:172.21.15.6:3300/0 conn(0x7f752c138340 0x7f752c0a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 -- 172.21.15.6:0/3634579384 >> v2:172.21.15.6:3300/0 conn(0x7f752c138340 msgr2=0x7f752c0a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 --2- 172.21.15.6:0/3634579384 >> v2:172.21.15.6:3300/0 conn(0x7f752c138340 0x7f752c0a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 -- 172.21.15.6:0/3634579384 >> v1:172.21.15.188:6789/0 conn(0x7f752c0a6f40 legacy=0x7f752c0a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.060+0000 7f752b7fe640 1 -- 172.21.15.6:0/3634579384 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c0a6a20 con 0x7f752c06c680 2024-04-26T00:50:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752b7fe640 1 --2- 172.21.15.6:0/3634579384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e50 tx=0x7f752401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec430e769bcc963c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7529ffb640 1 -- 172.21.15.6:0/3634579384 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240a5900 con 0x7f752c06c680 2024-04-26T00:50:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7529ffb640 1 -- 172.21.15.6:0/3634579384 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75240a5aa0 con 0x7f752c06c680 2024-04-26T00:50:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7529ffb640 1 -- 172.21.15.6:0/3634579384 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240ad3f0 con 0x7f752c06c680 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- 172.21.15.6:0/3634579384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 msgr2=0x7f752c14f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- 172.21.15.6:0/3634579384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e50 tx=0x7f752401ca10 comp rx=0 tx=0).stop 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- 172.21.15.6:0/3634579384 shutdown_connections 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- 172.21.15.6:0/3634579384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c14f7c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- 172.21.15.6:0/3634579384 >> v2:172.21.15.6:3300/0 conn(0x7f752c138340 0x7f752c0a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- 172.21.15.6:0/3634579384 >> 172.21.15.6:0/3634579384 conn(0x7f752c0b6ee0 msgr2=0x7f752c0b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- 172.21.15.6:0/3634579384 shutdown_connections 2024-04-26T00:50:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- 172.21.15.6:0/3634579384 wait complete. 2024-04-26T00:50:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 Processor -- start 2024-04-26T00:50:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- start start 2024-04-26T00:50:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c13e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f752c0a6f40 0x7f752c13d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 0x7f752c06f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f752c1528b0 con 0x7f752c06f510 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f752c152730 con 0x7f752c0a6f40 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f7531934640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f752c152a30 con 0x7f752c06c680 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 0x7f752c06f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c13e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 0x7f752c06f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37672/0 (socket says 172.21.15.6:37672) 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752b7fe640 1 -- 172.21.15.6:0/2103534869 learned_addr learned my addr 172.21.15.6:0/2103534869 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752a7fc640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f752c0a6f40 0x7f752c13d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 -- 172.21.15.6:0/2103534869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f752c0a6f40 msgr2=0x7f752c13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f752c0a6f40 0x7f752c13d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 -- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 msgr2=0x7f752c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 0x7f752c06f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 -- 172.21.15.6:0/2103534869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c0b5540 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.064+0000 7f752affd640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c13e950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f752000e8a0 tx=0x7f752000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520017070 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752000c940 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520009e60 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c06fee0 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c13e2a0 con 0x7f752c06c680 2024-04-26T00:50:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c06db70 con 0x7f752c06c680 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f752001a070 con 0x7f752c06c680 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 0x7f751809b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f752a7fc640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 0x7f751809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f75200c2220 con 0x7f752c06c680 2024-04-26T00:50:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.068+0000 7f752a7fc640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 0x7f751809b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752c0b3130 tx=0x7f751c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.072+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7520093110 con 0x7f752c06c680 2024-04-26T00:50:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.236+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f752c0b6960 con 0x7f752c06c680 2024-04-26T00:50:54.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.236+0000 7f7513fff640 1 -- 172.21.15.6:0/2103534869 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f7520092a10 con 0x7f752c06c680 2024-04-26T00:50:54.245 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 10 mgrc shutdown 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 msgr2=0x7f751809b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 0x7f751809b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752c0b3130 tx=0x7f751c009040 comp rx=0 tx=0).stop 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 msgr2=0x7f752c13e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c13e950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f752000e8a0 tx=0x7f752000ed60 comp rx=0 tx=0).stop 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 shutdown_connections 2024-04-26T00:50:54.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f75180993c0 0x7f751809b880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f752c06f510 0x7f752c06f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f752c0a6f40 0x7f752c13d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 --2- 172.21.15.6:0/2103534869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f752c06c680 0x7f752c13e950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 >> 172.21.15.6:0/2103534869 conn(0x7f752c0b6ee0 msgr2=0x7f752c0a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 shutdown_connections 2024-04-26T00:50:54.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.240+0000 7f7531934640 1 -- 172.21.15.6:0/2103534869 wait complete. 2024-04-26T00:50:54.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:50:54.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.380+0000 7fd286fbb640 1 Processor -- start 2024-04-26T00:50:54.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.380+0000 7fd286fbb640 1 -- start start 2024-04-26T00:50:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd286fbb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd280139500 0x7fd2800ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd286fbb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd286fbb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800723e0 con 0x7fd280135ed0 2024-04-26T00:50:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd286fbb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd280072a80 con 0x7fd280139500 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd286fbb640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800725f0 con 0x7fd2800ab9d0 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60938/0 (socket says 172.21.15.6:60938) 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 -- 172.21.15.6:0/3341392185 learned_addr learned my addr 172.21.15.6:0/3341392185 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd27ffff640 1 --2- 172.21.15.6:0/3341392185 >> v2:172.21.15.188:3300/0 conn(0x7fd280139500 0x7fd2800ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 -- 172.21.15.6:0/3341392185 >> v2:172.21.15.188:3300/0 conn(0x7fd280139500 msgr2=0x7fd2800ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 --2- 172.21.15.6:0/3341392185 >> v2:172.21.15.188:3300/0 conn(0x7fd280139500 0x7fd2800ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 -- 172.21.15.6:0/3341392185 >> v1:172.21.15.188:6789/0 conn(0x7fd280135ed0 legacy=0x7fd28006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 -- 172.21.15.6:0/3341392185 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd280135630 con 0x7fd2800ab9d0 2024-04-26T00:50:54.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.384+0000 7fd285558640 1 --2- 172.21.15.6:0/3341392185 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd270009870 tx=0x7fd27001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81551003e9cb3f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27f7fe640 1 -- 172.21.15.6:0/3341392185 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700b0070 con 0x7fd2800ab9d0 2024-04-26T00:50:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27f7fe640 1 -- 172.21.15.6:0/3341392185 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2700ab600 con 0x7fd2800ab9d0 2024-04-26T00:50:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27f7fe640 1 -- 172.21.15.6:0/3341392185 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700ab9d0 con 0x7fd2800ab9d0 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/3341392185 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 msgr2=0x7fd28014d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- 172.21.15.6:0/3341392185 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd270009870 tx=0x7fd27001c470 comp rx=0 tx=0).stop 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/3341392185 shutdown_connections 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- 172.21.15.6:0/3341392185 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2800ab9d0 0x7fd28014d730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- 172.21.15.6:0/3341392185 >> v2:172.21.15.188:3300/0 conn(0x7fd280139500 0x7fd2800ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/3341392185 >> 172.21.15.6:0/3341392185 conn(0x7fd28006cb40 msgr2=0x7fd28006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/3341392185 shutdown_connections 2024-04-26T00:50:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/3341392185 wait complete. 2024-04-26T00:50:54.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 Processor -- start 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- start start 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2800ab9d0 0x7fd2801dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 0x7fd280149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd280150490 con 0x7fd280135ed0 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd2801364c0 con 0x7fd2800ab9d0 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd280150610 con 0x7fd280139500 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 0x7fd280149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60946/0 (socket says 172.21.15.6:60946) 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 -- 172.21.15.6:0/2561542631 learned_addr learned my addr 172.21.15.6:0/2561542631 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd284d57640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2800ab9d0 0x7fd2801dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 -- 172.21.15.6:0/2561542631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2800ab9d0 msgr2=0x7fd2801dd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2800ab9d0 0x7fd2801dd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 -- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 msgr2=0x7fd280149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 0x7fd280149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 -- 172.21.15.6:0/2561542631 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2801de1b0 con 0x7fd280139500 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27ffff640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 0x7fd280149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd285558640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd27001ab20 tx=0x7fd270019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700b0040 con 0x7fd280139500 2024-04-26T00:50:54.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2700b9070 con 0x7fd280139500 2024-04-26T00:50:54.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2801de470 con 0x7fd280139500 2024-04-26T00:50:54.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700b4840 con 0x7fd280139500 2024-04-26T00:50:54.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.388+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2801ddde0 con 0x7fd280139500 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2800a63b0 con 0x7fd280139500 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd2700ab4a0 con 0x7fd280139500 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 0x7fd26c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd284d57640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 0x7fd26c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd27015cd20 con 0x7fd280139500 2024-04-26T00:50:54.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.392+0000 7fd284d57640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 0x7fd26c09b800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd278004e30 tx=0x7fd278009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.396+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd2800a63b0 con 0x7fd280139500 2024-04-26T00:50:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2800b6770 con 0x7fd280139500 2024-04-26T00:50:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd27d7fa640 1 -- 172.21.15.6:0/2561542631 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7fd2700160f0 con 0x7fd280139500 2024-04-26T00:50:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:54.601 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:50:54.601 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 10 mgrc shutdown 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 msgr2=0x7fd26c09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 0x7fd26c09b800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd278004e30 tx=0x7fd278009040 comp rx=0 tx=0).stop 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 msgr2=0x7fd280071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.592+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd27001ab20 tx=0x7fd270019210 comp rx=0 tx=0).stop 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 shutdown_connections 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd26c099340 0x7fd26c09b800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd280139500 0x7fd280071640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd280135ed0 0x7fd280149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 --2- 172.21.15.6:0/2561542631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2800ab9d0 0x7fd2801dd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 >> 172.21.15.6:0/2561542631 conn(0x7fd28006cb40 msgr2=0x7fd280137d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 shutdown_connections 2024-04-26T00:50:54.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.596+0000 7fd286fbb640 1 -- 172.21.15.6:0/2561542631 wait complete. 2024-04-26T00:50:54.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:54.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 Processor -- start 2024-04-26T00:50:54.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 -- start start 2024-04-26T00:50:54.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 0x7fd658150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6580a4ce0 con 0x7fd6580b47a0 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6580a3510 con 0x7fd65806cb00 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65cdd6640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd6580b3e30 con 0x7fd65814e8e0 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd656d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 0x7fd658150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6580b47a0 0x7fd6580a6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57028/0 (socket says 172.21.15.6:57028) 2024-04-26T00:50:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65659c640 1 -- 172.21.15.6:0/3605548602 learned_addr learned my addr 172.21.15.6:0/3605548602 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:54.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65559a640 1 -- 172.21.15.6:0/3605548602 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491814513 0 0) 0x7fd6580a4ce0 con 0x7fd6580b47a0 2024-04-26T00:50:54.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd656d9d640 1 -- 172.21.15.6:0/3605548602 >> v1:172.21.15.188:6789/0 conn(0x7fd65806cb00 legacy=0x7fd6580a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:54.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd656d9d640 1 -- 172.21.15.6:0/3605548602 >> v1:172.21.15.6:6789/0 conn(0x7fd6580b47a0 legacy=0x7fd6580a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd656d9d640 1 -- 172.21.15.6:0/3605548602 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6580b40f0 con 0x7fd65814e8e0 2024-04-26T00:50:54.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd656d9d640 1 --2- 172.21.15.6:0/3605548602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 0x7fd658150cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd650009d90 tx=0x7fd65001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c177716a0b9901e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65559a640 1 -- 172.21.15.6:0/3605548602 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6500b2070 con 0x7fd65814e8e0 2024-04-26T00:50:54.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65559a640 1 -- 172.21.15.6:0/3605548602 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6500a58e0 con 0x7fd65814e8e0 2024-04-26T00:50:54.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.732+0000 7fd65559a640 1 -- 172.21.15.6:0/3605548602 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6500a5cb0 con 0x7fd65814e8e0 2024-04-26T00:50:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/3605548602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 msgr2=0x7fd658150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/3605548602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 0x7fd658150cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd650009d90 tx=0x7fd65001c910 comp rx=0 tx=0).stop 2024-04-26T00:50:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/3605548602 shutdown_connections 2024-04-26T00:50:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/3605548602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65814e8e0 0x7fd658150cd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/3605548602 >> 172.21.15.6:0/3605548602 conn(0x7fd6580b71a0 msgr2=0x7fd6580b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/3605548602 shutdown_connections 2024-04-26T00:50:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/3605548602 wait complete. 2024-04-26T00:50:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 Processor -- start 2024-04-26T00:50:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- start start 2024-04-26T00:50:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 0x7fd658148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 0x7fd658133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd658153bb0 con 0x7fd65814e8e0 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd658153a30 con 0x7fd6580b47a0 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fd658153d30 con 0x7fd65806cb00 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd656d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 0x7fd658133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60954/0 (socket says 172.21.15.6:60954) 2024-04-26T00:50:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 -- 172.21.15.6:0/2226506240 learned_addr learned my addr 172.21.15.6:0/2226506240 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd655d9b640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 0x7fd658148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 -- 172.21.15.6:0/2226506240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 msgr2=0x7fd658148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 0x7fd658148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 -- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 msgr2=0x7fd658133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 0x7fd658133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 -- 172.21.15.6:0/2226506240 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd658140890 con 0x7fd65806cb00 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd655d9b640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 0x7fd658148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd656d9d640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 0x7fd658133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65659c640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c520 tx=0x7fd64800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648018070 con 0x7fd65806cb00 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6480074e0 con 0x7fd65806cb00 2024-04-26T00:50:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6480049f0 con 0x7fd65806cb00 2024-04-26T00:50:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd658140bb0 con 0x7fd65806cb00 2024-04-26T00:50:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd658070f30 con 0x7fd65806cb00 2024-04-26T00:50:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.736+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65806db70 con 0x7fd65806cb00 2024-04-26T00:50:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fd64801b070 con 0x7fd65806cb00 2024-04-26T00:50:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 0x7fd63809b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd655d9b640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 0x7fd63809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd6480c1b00 con 0x7fd65806cb00 2024-04-26T00:50:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.740+0000 7fd655d9b640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 0x7fd63809b880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd6580a61e0 tx=0x7fd64c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:54.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.744+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd648022080 con 0x7fd65806cb00 2024-04-26T00:50:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.908+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd65806b4b0 con 0x7fd65806cb00 2024-04-26T00:50:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.908+0000 7fd646ffd640 1 -- 172.21.15.6:0/2226506240 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7fd658140890 con 0x7fd65806cb00 2024-04-26T00:50:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 10 mgrc shutdown 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 msgr2=0x7fd63809b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 0x7fd63809b880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd6580a61e0 tx=0x7fd64c009040 comp rx=0 tx=0).stop 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 msgr2=0x7fd658072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c520 tx=0x7fd64800c9e0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 shutdown_connections 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fd6380993c0 0x7fd63809b880 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd65814e8e0 0x7fd658133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580b47a0 0x7fd658148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 --2- 172.21.15.6:0/2226506240 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd65806cb00 0x7fd658072870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 >> 172.21.15.6:0/2226506240 conn(0x7fd6580b71a0 msgr2=0x7fd6580b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 shutdown_connections 2024-04-26T00:50:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:54.912+0000 7fd65cdd6640 1 -- 172.21.15.6:0/2226506240 wait complete. 2024-04-26T00:50:54.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T00:50:28.326359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T00:50:33.296137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T00:50:37.659451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T00:50:38.192325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T00:50:54.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T00:50:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 Processor -- start 2024-04-26T00:50:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 -- start start 2024-04-26T00:50:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe82c06d2e0 0x7fe82c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c072b30 con 0x7fe82c071260 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c072900 con 0x7fe82c06d2e0 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe8341c7640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c071c70 con 0x7fe82c070a70 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60956/0 (socket says 172.21.15.6:60956) 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 -- 172.21.15.6:0/1972048959 learned_addr learned my addr 172.21.15.6:0/1972048959 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe832764640 1 --2- 172.21.15.6:0/1972048959 >> v2:172.21.15.188:3300/0 conn(0x7fe82c06d2e0 0x7fe82c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 -- 172.21.15.6:0/1972048959 >> v2:172.21.15.188:3300/0 conn(0x7fe82c06d2e0 msgr2=0x7fe82c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 --2- 172.21.15.6:0/1972048959 >> v2:172.21.15.188:3300/0 conn(0x7fe82c06d2e0 0x7fe82c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 -- 172.21.15.6:0/1972048959 >> v1:172.21.15.188:6789/0 conn(0x7fe82c071260 legacy=0x7fe82c1412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.048+0000 7fe831762640 1 -- 172.21.15.6:0/1972048959 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0a9d20 con 0x7fe82c070a70 2024-04-26T00:50:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831762640 1 --2- 172.21.15.6:0/1972048959 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f6becfe6f8f7ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe830f61640 1 -- 172.21.15.6:0/1972048959 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0b0070 con 0x7fe82c070a70 2024-04-26T00:50:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe830f61640 1 -- 172.21.15.6:0/1972048959 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c0ab600 con 0x7fe82c070a70 2024-04-26T00:50:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe830f61640 1 -- 172.21.15.6:0/1972048959 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0ab9d0 con 0x7fe82c070a70 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/1972048959 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 msgr2=0x7fe82c0723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- 172.21.15.6:0/1972048959 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c01c3e0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/1972048959 shutdown_connections 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- 172.21.15.6:0/1972048959 >> v2:172.21.15.188:3300/0 conn(0x7fe82c06d2e0 0x7fe82c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- 172.21.15.6:0/1972048959 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c070a70 0x7fe82c0723c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/1972048959 >> 172.21.15.6:0/1972048959 conn(0x7fe82c06f210 msgr2=0x7fe82c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/1972048959 shutdown_connections 2024-04-26T00:50:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/1972048959 wait complete. 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 Processor -- start 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- start start 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 0x7fe82c0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe82c071260 0x7fe82c0a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c14d280 con 0x7fe82c071260 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c141bd0 con 0x7fe82c070a70 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c14d400 con 0x7fe82c06d2e0 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60960/0 (socket says 172.21.15.6:60960) 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 -- 172.21.15.6:0/4213117524 learned_addr learned my addr 172.21.15.6:0/4213117524 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe832764640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe82c071260 0x7fe82c0a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831762640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 0x7fe82c0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 -- 172.21.15.6:0/4213117524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 msgr2=0x7fe82c0a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 0x7fe82c0a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 -- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe82c071260 msgr2=0x7fe82c0a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe82c071260 0x7fe82c0a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 -- 172.21.15.6:0/4213117524 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0a7490 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831762640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 0x7fe82c0a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe831f63640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b410 tx=0x7fe82400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824015030 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824004020 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c13d100 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824004450 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.052+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c0b65e0 con 0x7fe82c06d2e0 2024-04-26T00:50:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c06db70 con 0x7fe82c06d2e0 2024-04-26T00:50:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fe824018070 con 0x7fe82c06d2e0 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 0x7fe81009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe831762640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 0x7fe81009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fe8240c2680 con 0x7fe82c06d2e0 2024-04-26T00:50:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.056+0000 7fe831762640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 0x7fe81009b880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0ad000 tx=0x7fe81c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.060+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe824093570 con 0x7fe82c06d2e0 2024-04-26T00:50:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.220+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe82c13fa30 con 0x7fe82c06d2e0 2024-04-26T00:50:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.220+0000 7fe8227fc640 1 -- 172.21.15.6:0/4213117524 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe824092e70 con 0x7fe82c06d2e0 2024-04-26T00:50:55.229 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.220+0000 7fe8341c7640 10 mgrc shutdown 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.220+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 msgr2=0x7fe81009b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.220+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 0x7fe81009b880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0ad000 tx=0x7fe81c008040 comp rx=0 tx=0).stop 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 msgr2=0x7fe82c0b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b410 tx=0x7fe82400b8d0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 shutdown_connections 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8100993c0 0x7fe81009b880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe82c071260 0x7fe82c0a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe82c070a70 0x7fe82c0a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 --2- 172.21.15.6:0/4213117524 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe82c06d2e0 0x7fe82c0b6d60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 >> 172.21.15.6:0/4213117524 conn(0x7fe82c06f210 msgr2=0x7fe82c141080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 shutdown_connections 2024-04-26T00:50:55.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.224+0000 7fe8341c7640 1 -- 172.21.15.6:0/4213117524 wait complete. 2024-04-26T00:50:55.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T00:50:55.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.364+0000 7fe494e79640 1 Processor -- start 2024-04-26T00:50:55.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.364+0000 7fe494e79640 1 -- start start 2024-04-26T00:50:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4900ac4a0 0x7fe49014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe490135530 con 0x7fe49014baf0 2024-04-26T00:50:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4901357f0 con 0x7fe490135ef0 2024-04-26T00:50:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe4900acc40 con 0x7fe4900ac4a0 2024-04-26T00:50:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4900ac4a0 0x7fe49014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe49014baf0 0x7fe49014dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57036/0 (socket says 172.21.15.6:57036) 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48ed9d640 1 -- 172.21.15.6:0/2277920609 learned_addr learned my addr 172.21.15.6:0/2277920609 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 --2- 172.21.15.6:0/2277920609 >> v2:172.21.15.6:3300/0 conn(0x7fe4900ac4a0 0x7fe49014b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37710/0 (socket says 172.21.15.6:37710) 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 -- 172.21.15.6:0/2277920609 >> v1:172.21.15.188:6789/0 conn(0x7fe490135ef0 legacy=0x7fe4900b9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 -- 172.21.15.6:0/2277920609 >> v1:172.21.15.6:6789/0 conn(0x7fe49014baf0 legacy=0x7fe49014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 -- 172.21.15.6:0/2277920609 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4901362d0 con 0x7fe4900ac4a0 2024-04-26T00:50:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48dd9b640 1 --2- 172.21.15.6:0/2277920609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe49014b5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097c0 tx=0x7fe48001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2e9cde5fc18f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48d59a640 1 -- 172.21.15.6:0/2277920609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800b0070 con 0x7fe4900ac4a0 2024-04-26T00:50:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48d59a640 1 -- 172.21.15.6:0/2277920609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800ab600 con 0x7fe4900ac4a0 2024-04-26T00:50:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe48d59a640 1 -- 172.21.15.6:0/2277920609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800ab9d0 con 0x7fe4900ac4a0 2024-04-26T00:50:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- 172.21.15.6:0/2277920609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 msgr2=0x7fe49014b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 --2- 172.21.15.6:0/2277920609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe49014b5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097c0 tx=0x7fe48001c320 comp rx=0 tx=0).stop 2024-04-26T00:50:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- 172.21.15.6:0/2277920609 shutdown_connections 2024-04-26T00:50:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 --2- 172.21.15.6:0/2277920609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe49014b5b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- 172.21.15.6:0/2277920609 >> 172.21.15.6:0/2277920609 conn(0x7fe490070470 msgr2=0x7fe4900b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- 172.21.15.6:0/2277920609 shutdown_connections 2024-04-26T00:50:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.368+0000 7fe494e79640 1 -- 172.21.15.6:0/2277920609 wait complete. 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 Processor -- start 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- start start 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe490135ef0 0x7fe490133550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe49014baf0 0x7fe490133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe4901393b0 con 0x7fe4900ac4a0 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4900729c0 con 0x7fe490135ef0 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe490139530 con 0x7fe49014baf0 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37712/0 (socket says 172.21.15.6:37712) 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 -- 172.21.15.6:0/829986896 learned_addr learned my addr 172.21.15.6:0/829986896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48ed9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe49014baf0 0x7fe490133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48dd9b640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe490135ef0 0x7fe490133550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 -- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe49014baf0 msgr2=0x7fe490133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe49014baf0 0x7fe490133a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 -- 172.21.15.6:0/829986896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe490135ef0 msgr2=0x7fe490133550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe490135ef0 0x7fe490133550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 -- 172.21.15.6:0/829986896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49006ec40 con 0x7fe4900ac4a0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe48e59c640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478012830 con 0x7fe4900ac4a0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe478017070 con 0x7fe4900ac4a0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478012c30 con 0x7fe4900ac4a0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe490134700 con 0x7fe4900ac4a0 2024-04-26T00:50:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4900a7630 con 0x7fe4900ac4a0 2024-04-26T00:50:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49006db70 con 0x7fe4900ac4a0 2024-04-26T00:50:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fe47801c460 con 0x7fe4900ac4a0 2024-04-26T00:50:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.372+0000 7fe486ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 0x7fe47009b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe48dd9b640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 0x7fe47009b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fe4780c2b70 con 0x7fe4900ac4a0 2024-04-26T00:50:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe48dd9b640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 0x7fe47009b830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4800ad000 tx=0x7fe480008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.376+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe478093b00 con 0x7fe4900ac4a0 2024-04-26T00:50:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fe4900ab1c0 con 0x7fe4900ac4a0 2024-04-26T00:50:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe486ffd640 1 -- 172.21.15.6:0/829986896 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (secure 0 0 0) 0x7fe478093400 con 0x7fe4900ac4a0 2024-04-26T00:50:55.548 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 10 mgrc shutdown 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 msgr2=0x7fe47009b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 0x7fe47009b830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4800ad000 tx=0x7fe480008040 comp rx=0 tx=0).stop 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 msgr2=0x7fe4900a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c910 comp rx=0 tx=0).stop 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 shutdown_connections 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe470099370 0x7fe47009b830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe49014baf0 0x7fe490133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe490135ef0 0x7fe490133550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 --2- 172.21.15.6:0/829986896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4900ac4a0 0x7fe4900a44c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.540+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 >> 172.21.15.6:0/829986896 conn(0x7fe490070470 msgr2=0x7fe49006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.544+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 shutdown_connections 2024-04-26T00:50:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.544+0000 7fe494e79640 1 -- 172.21.15.6:0/829986896 wait complete. 2024-04-26T00:50:55.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T00:50:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 Processor -- start 2024-04-26T00:50:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 -- start start 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 0x7facf8071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7facf80a7530 0x7facf8072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf8072bc0 con 0x7facf806b1a0 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7facf80730f0 con 0x7facf80a7530 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facff25e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7facf8146310 con 0x7facf8146e70 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfd7fb640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7facf806b1a0 0x7facf806b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57052/0 (socket says 172.21.15.6:57052) 2024-04-26T00:50:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfd7fb640 1 -- 172.21.15.6:0/2639142285 learned_addr learned my addr 172.21.15.6:0/2639142285 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfcffa640 1 --2- 172.21.15.6:0/2639142285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 0x7facf8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facf7fff640 1 --2- 172.21.15.6:0/2639142285 >> v2:172.21.15.188:3300/0 conn(0x7facf80a7530 0x7facf8072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfcffa640 1 -- 172.21.15.6:0/2639142285 >> v2:172.21.15.188:3300/0 conn(0x7facf80a7530 msgr2=0x7facf8072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfcffa640 1 --2- 172.21.15.6:0/2639142285 >> v2:172.21.15.188:3300/0 conn(0x7facf80a7530 0x7facf8072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facf77fe640 1 -- 172.21.15.6:0/2639142285 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080826443 0 0) 0x7facf8072bc0 con 0x7facf806b1a0 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfcffa640 1 -- 172.21.15.6:0/2639142285 >> v1:172.21.15.6:6789/0 conn(0x7facf806b1a0 legacy=0x7facf806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.680+0000 7facfcffa640 1 -- 172.21.15.6:0/2639142285 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf8073570 con 0x7facf8146e70 2024-04-26T00:50:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 --2- 172.21.15.6:0/2639142285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 0x7facf8071240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7face80097c0 tx=0x7face801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695a9d5cd2b9868c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facf77fe640 1 -- 172.21.15.6:0/2639142285 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80b0070 con 0x7facf8146e70 2024-04-26T00:50:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facf77fe640 1 -- 172.21.15.6:0/2639142285 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face80ab600 con 0x7facf8146e70 2024-04-26T00:50:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facf77fe640 1 -- 172.21.15.6:0/2639142285 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80ab9d0 con 0x7facf8146e70 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- 172.21.15.6:0/2639142285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 msgr2=0x7facf8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- 172.21.15.6:0/2639142285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 0x7facf8071240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7face80097c0 tx=0x7face801c3b0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- 172.21.15.6:0/2639142285 shutdown_connections 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- 172.21.15.6:0/2639142285 >> v2:172.21.15.188:3300/0 conn(0x7facf80a7530 0x7facf8072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- 172.21.15.6:0/2639142285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf8146e70 0x7facf8071240 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- 172.21.15.6:0/2639142285 >> 172.21.15.6:0/2639142285 conn(0x7facf80702f0 msgr2=0x7facf8070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- 172.21.15.6:0/2639142285 shutdown_connections 2024-04-26T00:50:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- 172.21.15.6:0/2639142285 wait complete. 2024-04-26T00:50:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 Processor -- start 2024-04-26T00:50:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- start start 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf80a7530 0x7facf80b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf8146e70 0x7facf8131cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7facf80ab2d0 con 0x7facf80a7530 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facf8072970 con 0x7facf8146e70 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facff25e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7facf80a7910 con 0x7facf806b1a0 2024-04-26T00:50:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf80a7530 0x7facf80b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:60998/0 (socket says 172.21.15.6:60998) 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 -- 172.21.15.6:0/2715069296 learned_addr learned my addr 172.21.15.6:0/2715069296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfd7fb640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf8146e70 0x7facf8131cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 -- 172.21.15.6:0/2715069296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf8146e70 msgr2=0x7facf8131cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf8146e70 0x7facf8131cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 -- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf80a7530 msgr2=0x7facf80b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf80a7530 0x7facf80b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.684+0000 7facfcffa640 1 -- 172.21.15.6:0/2715069296 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf8132850 con 0x7facf806b1a0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facfcffa640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7face80ae040 tx=0x7face8019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80b8030 con 0x7facf806b1a0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face80ab400 con 0x7facf806b1a0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf80b63c0 con 0x7facf806b1a0 2024-04-26T00:50:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80b0040 con 0x7facf806b1a0 2024-04-26T00:50:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facf8132ac0 con 0x7facf806b1a0 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf806db70 con 0x7facf806b1a0 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7face80bb070 con 0x7facf806b1a0 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 0x7face409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf7fff640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 0x7face409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7face815c1a0 con 0x7facf806b1a0 2024-04-26T00:50:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.688+0000 7facf7fff640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 0x7face409b800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facf80a6dd0 tx=0x7facec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:55.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.692+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7face80c2070 con 0x7facf806b1a0 2024-04-26T00:50:55.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.856+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7facf814e3d0 con 0x7facf806b1a0 2024-04-26T00:50:55.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.856+0000 7facf57fa640 1 -- 172.21.15.6:0/2715069296 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7facf80b63c0 con 0x7facf806b1a0 2024-04-26T00:50:55.865 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 10 mgrc shutdown 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 msgr2=0x7face409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 0x7face409b800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facf80a6dd0 tx=0x7facec008040 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 msgr2=0x7facf80a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7face80ae040 tx=0x7face8019150 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 shutdown_connections 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7face4099340 0x7face409b800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf8146e70 0x7facf8131cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf80a7530 0x7facf80b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 --2- 172.21.15.6:0/2715069296 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facf806b1a0 0x7facf80a5740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 >> 172.21.15.6:0/2715069296 conn(0x7facf80702f0 msgr2=0x7facf80a2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 shutdown_connections 2024-04-26T00:50:55.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:55.860+0000 7facff25e640 1 -- 172.21.15.6:0/2715069296 wait complete. 2024-04-26T00:50:55.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T00:50:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 Processor -- start 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 -- start start 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 0x7fe8f80aa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8f814b620 0x7fe8f814da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f80a8120 con 0x7fe8f8072910 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f8071310 con 0x7fe8f814b620 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ff562640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f8072fc0 con 0x7fe8f80a5a90 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fd2fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 0x7fe8f80aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fcafd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe8f8072910 0x7fe8f80b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57062/0 (socket says 172.21.15.6:57062) 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fcafd640 1 -- 172.21.15.6:0/3189986858 learned_addr learned my addr 172.21.15.6:0/3189986858 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fdaff640 1 --2- 172.21.15.6:0/3189986858 >> v2:172.21.15.6:3300/0 conn(0x7fe8f814b620 0x7fe8f814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8ebfff640 1 -- 172.21.15.6:0/3189986858 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632251958 0 0) 0x7fe8f80a8120 con 0x7fe8f8072910 2024-04-26T00:50:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fd2fe640 1 -- 172.21.15.6:0/3189986858 >> v2:172.21.15.6:3300/0 conn(0x7fe8f814b620 msgr2=0x7fe8f814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fd2fe640 1 --2- 172.21.15.6:0/3189986858 >> v2:172.21.15.6:3300/0 conn(0x7fe8f814b620 0x7fe8f814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fd2fe640 1 -- 172.21.15.6:0/3189986858 >> v1:172.21.15.6:6789/0 conn(0x7fe8f8072910 legacy=0x7fe8f80b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.000+0000 7fe8fd2fe640 1 -- 172.21.15.6:0/3189986858 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80aaa90 con 0x7fe8f80a5a90 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8fd2fe640 1 --2- 172.21.15.6:0/3189986858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 0x7fe8f80aa410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097c0 tx=0x7fe8f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4f5823d30aa898 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ebfff640 1 -- 172.21.15.6:0/3189986858 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40b2070 con 0x7fe8f80a5a90 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ebfff640 1 -- 172.21.15.6:0/3189986858 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f40ad640 con 0x7fe8f80a5a90 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ebfff640 1 -- 172.21.15.6:0/3189986858 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40ada10 con 0x7fe8f80a5a90 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- 172.21.15.6:0/3189986858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 msgr2=0x7fe8f80aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- 172.21.15.6:0/3189986858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 0x7fe8f80aa410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097c0 tx=0x7fe8f401c480 comp rx=0 tx=0).stop 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- 172.21.15.6:0/3189986858 shutdown_connections 2024-04-26T00:50:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- 172.21.15.6:0/3189986858 >> v2:172.21.15.6:3300/0 conn(0x7fe8f814b620 0x7fe8f814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- 172.21.15.6:0/3189986858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f80a5a90 0x7fe8f80aa410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- 172.21.15.6:0/3189986858 >> 172.21.15.6:0/3189986858 conn(0x7fe8f806e7b0 msgr2=0x7fe8f80b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- 172.21.15.6:0/3189986858 shutdown_connections 2024-04-26T00:50:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- 172.21.15.6:0/3189986858 wait complete. 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 Processor -- start 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- start start 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 0x7fe8f81458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe8f8145e20 0x7fe8f80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f8139420 con 0x7fe8f80a5a90 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f8073830 con 0x7fe8f8145e20 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8ff562640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f81395a0 con 0x7fe8f814b620 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8fd2fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8fcafd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 0x7fe8f81458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8fd2fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37734/0 (socket says 172.21.15.6:37734) 2024-04-26T00:50:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.004+0000 7fe8fd2fe640 1 -- 172.21.15.6:0/650541252 learned_addr learned my addr 172.21.15.6:0/650541252 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 -- 172.21.15.6:0/650541252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe8f8145e20 msgr2=0x7fe8f80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe8f8145e20 0x7fe8f80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 -- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 msgr2=0x7fe8f80a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 -- 172.21.15.6:0/650541252 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f8145170 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fd2fe640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8fcafd640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 0x7fe8f81458e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80a82f0 tx=0x7fe8ec00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec017070 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec005d10 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f8144280 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec007310 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f80a5120 con 0x7fe8f814b620 2024-04-26T00:50:56.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f806db70 con 0x7fe8f814b620 2024-04-26T00:50:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fe8ec01a070 con 0x7fe8f814b620 2024-04-26T00:50:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.008+0000 7fe8e9ffb640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 0x7fe8dc09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.012+0000 7fe8fd2fe640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 0x7fe8dc09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.012+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fe8ec0c1900 con 0x7fe8f814b620 2024-04-26T00:50:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.012+0000 7fe8fd2fe640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 0x7fe8dc09b800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8f401c4c0 tx=0x7fe8f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.012+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe8ec021020 con 0x7fe8f814b620 2024-04-26T00:50:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8f814c3d0 con 0x7fe8f814b620 2024-04-26T00:50:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8e9ffb640 1 -- 172.21.15.6:0/650541252 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe8ec092890 con 0x7fe8f814b620 2024-04-26T00:50:56.180 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-04-26T00:50:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 10 mgrc shutdown 2024-04-26T00:50:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 msgr2=0x7fe8dc09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 0x7fe8dc09b800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8f401c4c0 tx=0x7fe8f4008040 comp rx=0 tx=0).stop 2024-04-26T00:50:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 msgr2=0x7fe8f81458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 0x7fe8f81458e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80a82f0 tx=0x7fe8ec00c870 comp rx=0 tx=0).stop 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 shutdown_connections 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fe8dc099340 0x7fe8dc09b800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe8f8145e20 0x7fe8f80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8f814b620 0x7fe8f81458e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 --2- 172.21.15.6:0/650541252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8f80a5a90 0x7fe8f80a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 >> 172.21.15.6:0/650541252 conn(0x7fe8f806e7b0 msgr2=0x7fe8f8135490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 shutdown_connections 2024-04-26T00:50:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.172+0000 7fe8ff562640 1 -- 172.21.15.6:0/650541252 wait complete. 2024-04-26T00:50:56.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:50:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.308+0000 7f3979c02640 1 Processor -- start 2024-04-26T00:50:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.308+0000 7f3979c02640 1 -- start start 2024-04-26T00:50:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3974071710 con 0x7f3974138390 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3974072df0 con 0x7f39740a58b0 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f3974072b30 con 0x7f39740723c0 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39737fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51846/0 (socket says 172.21.15.6:51846) 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39737fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58048/0 (socket says 172.21.15.6:58048) 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 -- 172.21.15.6:0/2278108432 learned_addr learned my addr 172.21.15.6:0/2278108432 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 -- 172.21.15.6:0/2278108432 >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 msgr2=0x7f39740b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 --2- 172.21.15.6:0/2278108432 >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 -- 172.21.15.6:0/2278108432 >> v1:172.21.15.188:6789/0 conn(0x7f3974138390 legacy=0x7f3974071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 -- 172.21.15.6:0/2278108432 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740a7f10 con 0x7f39740723c0 2024-04-26T00:50:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39737fe640 1 --2- 172.21.15.6:0/2278108432 >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3973fff640 1 --2- 172.21.15.6:0/2278108432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3964009870 tx=0x7f396401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41bba31204d9ab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39727fc640 1 -- 172.21.15.6:0/2278108432 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39640ab650 con 0x7f39740723c0 2024-04-26T00:50:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39727fc640 1 -- 172.21.15.6:0/2278108432 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39640b0070 con 0x7f39740723c0 2024-04-26T00:50:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f39727fc640 1 -- 172.21.15.6:0/2278108432 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39640aba10 con 0x7f39740723c0 2024-04-26T00:50:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- 172.21.15.6:0/2278108432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 msgr2=0x7f3974073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 --2- 172.21.15.6:0/2278108432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3964009870 tx=0x7f396401c430 comp rx=0 tx=0).stop 2024-04-26T00:50:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- 172.21.15.6:0/2278108432 shutdown_connections 2024-04-26T00:50:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 --2- 172.21.15.6:0/2278108432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f3974073240 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 --2- 172.21.15.6:0/2278108432 >> v2:172.21.15.6:3300/0 conn(0x7f39740a58b0 0x7f39740b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- 172.21.15.6:0/2278108432 >> 172.21.15.6:0/2278108432 conn(0x7f397406e230 msgr2=0x7f39740b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- 172.21.15.6:0/2278108432 shutdown_connections 2024-04-26T00:50:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.312+0000 7f3979c02640 1 -- 172.21.15.6:0/2278108432 wait complete. 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 Processor -- start 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- start start 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740a58b0 0x7f39740ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3974138390 0x7f39741e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f397414f1d0 con 0x7f3974138390 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f397414f050 con 0x7f39740a58b0 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f397414f350 con 0x7f39740723c0 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51852/0 (socket says 172.21.15.6:51852) 2024-04-26T00:50:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 -- 172.21.15.6:0/955465737 learned_addr learned my addr 172.21.15.6:0/955465737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3973fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3974138390 0x7f39741e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 -- 172.21.15.6:0/955465737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740a58b0 msgr2=0x7f39740ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740a58b0 0x7f39740ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 -- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3974138390 msgr2=0x7f39741e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3974138390 0x7f39741e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 -- 172.21.15.6:0/955465737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740b0460 con 0x7f39740723c0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f39737fe640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f396c00efc0 tx=0x7f396c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c018020 con 0x7f39740723c0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c014680 con 0x7f39740723c0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39740b01a0 con 0x7f39740723c0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c014a50 con 0x7f39740723c0 2024-04-26T00:50:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39740aec30 con 0x7f39740723c0 2024-04-26T00:50:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397406db70 con 0x7f39740723c0 2024-04-26T00:50:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f396c01b020 con 0x7f39740723c0 2024-04-26T00:50:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.316+0000 7f395bfff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f395bfff640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f395bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f395bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f395bfff640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 0x7f396009b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f3972ffd640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 0x7f396009b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f396c0c3280 con 0x7f39740723c0 2024-04-26T00:50:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.320+0000 7f3972ffd640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 0x7f396009b800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39741431d0 tx=0x7f3968006bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.324+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f396c022030 con 0x7f39740723c0 2024-04-26T00:50:56.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.520+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39740a4710 con 0x7f39740723c0 2024-04-26T00:50:56.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.520+0000 7f395bfff640 1 -- 172.21.15.6:0/955465737 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7f396c010040 con 0x7f39740723c0 2024-04-26T00:50:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:56.530 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:50:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:50:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 10 mgrc shutdown 2024-04-26T00:50:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 msgr2=0x7f396009b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 0x7f396009b800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39741431d0 tx=0x7f3968006bd0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 msgr2=0x7f39740afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f396c00efc0 tx=0x7f396c00c490 comp rx=0 tx=0).stop 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 shutdown_connections 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f3960099340 0x7f396009b800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3974138390 0x7f39741e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740a58b0 0x7f39740ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 --2- 172.21.15.6:0/955465737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f39740723c0 0x7f39740afa50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 >> 172.21.15.6:0/955465737 conn(0x7f397406e230 msgr2=0x7f397406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 shutdown_connections 2024-04-26T00:50:56.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.524+0000 7f3979c02640 1 -- 172.21.15.6:0/955465737 wait complete. 2024-04-26T00:50:56.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:50:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.660+0000 7f0e7da8a640 1 Processor -- start 2024-04-26T00:50:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.660+0000 7f0e7da8a640 1 -- start start 2024-04-26T00:50:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.660+0000 7f0e7da8a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0e781383f0 0x7f0e78072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e781454d0 con 0x7f0e78072bc0 2024-04-26T00:50:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0e78073050 con 0x7f0e781383f0 2024-04-26T00:50:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0e78145790 con 0x7f0e780a6aa0 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51864/0 (socket says 172.21.15.6:51864) 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 -- 172.21.15.6:0/2961860838 learned_addr learned my addr 172.21.15.6:0/2961860838 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 -- 172.21.15.6:0/2961860838 >> v2:172.21.15.188:3300/0 conn(0x7f0e781383f0 msgr2=0x7f0e78072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e76ffd640 1 --2- 172.21.15.6:0/2961860838 >> v2:172.21.15.188:3300/0 conn(0x7f0e781383f0 0x7f0e78072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 --2- 172.21.15.6:0/2961860838 >> v2:172.21.15.188:3300/0 conn(0x7f0e781383f0 0x7f0e78072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 -- 172.21.15.6:0/2961860838 >> v1:172.21.15.188:6789/0 conn(0x7f0e78072bc0 legacy=0x7f0e780711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 -- 172.21.15.6:0/2961860838 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78071900 con 0x7f0e780a6aa0 2024-04-26T00:50:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e777fe640 1 --2- 172.21.15.6:0/2961860838 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009e50 tx=0x7f0e6801c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88ec1dbe67b6eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e767fc640 1 -- 172.21.15.6:0/2961860838 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680a5870 con 0x7f0e780a6aa0 2024-04-26T00:50:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e767fc640 1 -- 172.21.15.6:0/2961860838 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e680a5a10 con 0x7f0e780a6aa0 2024-04-26T00:50:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e767fc640 1 -- 172.21.15.6:0/2961860838 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680a5de0 con 0x7f0e780a6aa0 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- 172.21.15.6:0/2961860838 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 msgr2=0x7f0e780a7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/2961860838 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009e50 tx=0x7f0e6801c9d0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- 172.21.15.6:0/2961860838 shutdown_connections 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/2961860838 >> v2:172.21.15.188:3300/0 conn(0x7f0e781383f0 0x7f0e78072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/2961860838 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a6aa0 0x7f0e780a7330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- 172.21.15.6:0/2961860838 >> 172.21.15.6:0/2961860838 conn(0x7f0e7806cb40 msgr2=0x7f0e7806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- 172.21.15.6:0/2961860838 shutdown_connections 2024-04-26T00:50:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.664+0000 7f0e7da8a640 1 -- 172.21.15.6:0/2961860838 wait complete. 2024-04-26T00:50:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 Processor -- start 2024-04-26T00:50:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- start start 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 0x7f0e7814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7814f2e0 con 0x7f0e780a6aa0 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7814f160 con 0x7f0e781383f0 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7814f460 con 0x7f0e780a52e0 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58064/0 (socket says 172.21.15.6:58064) 2024-04-26T00:50:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51880/0 (socket says 172.21.15.6:51880) 2024-04-26T00:50:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 -- 172.21.15.6:0/3951135567 learned_addr learned my addr 172.21.15.6:0/3951135567 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e76ffd640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 0x7f0e7814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 -- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 msgr2=0x7f0e7814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 -- 172.21.15.6:0/3951135567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 msgr2=0x7f0e7814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 0x7f0e7814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 -- 172.21.15.6:0/3951135567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78149010 con 0x7f0e780a6aa0 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e77fff640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e76ffd640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 0x7f0e7814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e777fe640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0e6801b080 tx=0x7f0e68019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680bc020 con 0x7f0e780a6aa0 2024-04-26T00:50:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e680b8880 con 0x7f0e780a6aa0 2024-04-26T00:50:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e780b81a0 con 0x7f0e780a6aa0 2024-04-26T00:50:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e680b8c70 con 0x7f0e780a6aa0 2024-04-26T00:50:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7814a540 con 0x7f0e780a6aa0 2024-04-26T00:50:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.668+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7806db70 con 0x7f0e780a6aa0 2024-04-26T00:50:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f0e680bf020 con 0x7f0e780a6aa0 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 0x7f0e6409b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e76ffd640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 0x7f0e6409b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f0e6815daf0 con 0x7f0e780a6aa0 2024-04-26T00:50:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.672+0000 7f0e76ffd640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 0x7f0e6409b830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e78143b50 tx=0x7f0e6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.676+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0e680c6070 con 0x7f0e780a6aa0 2024-04-26T00:50:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.832+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e78143c60 con 0x7f0e780a6aa0 2024-04-26T00:50:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e5ffff640 1 -- 172.21.15.6:0/3951135567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13549 (secure 0 0 0) 0x7f0e680165c0 con 0x7f0e780a6aa0 2024-04-26T00:50:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:50:40.835928+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 10 mgrc shutdown 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 msgr2=0x7f0e6409b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 0x7f0e6409b830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e78143b50 tx=0x7f0e6c008040 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 msgr2=0x7f0e780b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0e6801b080 tx=0x7f0e68019770 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 shutdown_connections 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f0e64099370 0x7f0e6409b830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e780a52e0 0x7f0e7814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e781383f0 0x7f0e7814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 --2- 172.21.15.6:0/3951135567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780a6aa0 0x7f0e780b7450 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 >> 172.21.15.6:0/3951135567 conn(0x7f0e7806cb40 msgr2=0x7f0e78074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.836+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 shutdown_connections 2024-04-26T00:50:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.840+0000 7f0e7da8a640 1 -- 172.21.15.6:0/3951135567 wait complete. 2024-04-26T00:50:56.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:50:56.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 Processor -- start 2024-04-26T00:50:56.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 -- start start 2024-04-26T00:50:56.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 0x7f5d7c0a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7c0b3e40 con 0x7f5d7c06cd80 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5d7c0a7490 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d8119f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c0b3be0 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51888/0 (socket says 172.21.15.6:51888) 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 -- 172.21.15.6:0/2968442384 learned_addr learned my addr 172.21.15.6:0/2968442384 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7b59e640 1 --2- 172.21.15.6:0/2968442384 >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 0x7f5d7c0a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 -- 172.21.15.6:0/2968442384 >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 msgr2=0x7f5d7c0a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/2968442384 >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 0x7f5d7c0a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 -- 172.21.15.6:0/2968442384 >> v1:172.21.15.188:6789/0 conn(0x7f5d7c06cd80 legacy=0x7f5d7c0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 -- 172.21.15.6:0/2968442384 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c0b4100 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7b59e640 1 --2- 172.21.15.6:0/2968442384 >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 0x7f5d7c0a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.968+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/2968442384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef17029fe3258b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d79d9b640 1 -- 172.21.15.6:0/2968442384 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0b0070 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d79d9b640 1 -- 172.21.15.6:0/2968442384 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0ab600 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d79d9b640 1 -- 172.21.15.6:0/2968442384 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0ab9d0 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/2968442384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 msgr2=0x7f5d7c13b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- 172.21.15.6:0/2968442384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c01c470 comp rx=0 tx=0).stop 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/2968442384 shutdown_connections 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- 172.21.15.6:0/2968442384 >> v2:172.21.15.188:3300/0 conn(0x7f5d7c0a47a0 0x7f5d7c0a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- 172.21.15.6:0/2968442384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a70b0 0x7f5d7c13b340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/2968442384 >> 172.21.15.6:0/2968442384 conn(0x7f5d7c0b7450 msgr2=0x7f5d7c0b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/2968442384 shutdown_connections 2024-04-26T00:50:56.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/2968442384 wait complete. 2024-04-26T00:50:56.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 Processor -- start 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- start start 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 0x7f5d7c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 0x7f5d7c12dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c152630 con 0x7f5d7c0a70b0 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c1524b0 con 0x7f5d7c06cd80 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c1527b0 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51894/0 (socket says 172.21.15.6:51894) 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 -- 172.21.15.6:0/1386485695 learned_addr learned my addr 172.21.15.6:0/1386485695 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7b59e640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 0x7f5d7c12dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 0x7f5d7c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 -- 172.21.15.6:0/1386485695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 msgr2=0x7f5d7c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 0x7f5d7c0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 -- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 msgr2=0x7f5d7c12dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 0x7f5d7c12dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 -- 172.21.15.6:0/1386485695 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c0713a0 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 0x7f5d7c0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7b59e640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 0x7f5d7c12dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d7a59c640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c480 tx=0x7f5d7000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70012830 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d70017070 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c13ac00 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70012c30 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.972+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c137ca0 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c06db70 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f5d7001c460 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 0x7f5d6809b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 0x7f5d6809b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f5d700c2b40 con 0x7f5d7c0a47a0 2024-04-26T00:50:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.976+0000 7f5d7ad9d640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 0x7f5d6809b830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0ad000 tx=0x7f5d6c0a6000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:56.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:56.980+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5d70093ad0 con 0x7f5d7c0a47a0 2024-04-26T00:50:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.172+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d7c0a7e10 con 0x7f5d7c0a47a0 2024-04-26T00:50:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.172+0000 7f5d637fe640 1 -- 172.21.15.6:0/1386485695 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7f5d700933d0 con 0x7f5d7c0a47a0 2024-04-26T00:50:57.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:50:57.182 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:50:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:50:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 10 mgrc shutdown 2024-04-26T00:50:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 msgr2=0x7f5d6809b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 0x7f5d6809b830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0ad000 tx=0x7f5d6c0a6000 comp rx=0 tx=0).stop 2024-04-26T00:50:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 msgr2=0x7f5d7c137760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c480 tx=0x7f5d7000c940 comp rx=0 tx=0).stop 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 shutdown_connections 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f5d68099370 0x7f5d6809b830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d7c0a70b0 0x7f5d7c12dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d7c0a47a0 0x7f5d7c137760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 --2- 172.21.15.6:0/1386485695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d7c06cd80 0x7f5d7c0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 >> 172.21.15.6:0/1386485695 conn(0x7f5d7c0b7450 msgr2=0x7f5d7c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 shutdown_connections 2024-04-26T00:50:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.176+0000 7f5d8119f640 1 -- 172.21.15.6:0/1386485695 wait complete. 2024-04-26T00:50:57.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T00:50:39.211984+0000', 'modified': '2024-04-26T00:50:42.225246+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4243': {'gid': 4243, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6825/3094432965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6824', 'nonce': 3094432965}, {'type': 'v1', 'addr': '172.21.15.188:6825', 'nonce': 3094432965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4243, 'qdb_cluster': [4243]} 2024-04-26T00:50:57.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T00:50:57.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T00:50:57.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 Processor -- start 2024-04-26T00:50:57.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 -- start start 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f48e406bb10 0x7f48e4071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e40a5650 0x7f48e40a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f48e406bef0 con 0x7f48e40a5650 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f48e41381a0 con 0x7f48e406bb10 2024-04-26T00:50:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e9249640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f48e4072fa0 con 0x7f48e4138380 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e40a5650 0x7f48e40a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e40a5650 0x7f48e40a7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58080/0 (socket says 172.21.15.6:58080) 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51908/0 (socket says 172.21.15.6:51908) 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 -- 172.21.15.6:0/1799627132 learned_addr learned my addr 172.21.15.6:0/1799627132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/1799627132 >> v2:172.21.15.188:3300/0 conn(0x7f48e406bb10 0x7f48e4071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 -- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 msgr2=0x7f48e4072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 -- 172.21.15.6:0/1799627132 >> v2:172.21.15.188:3300/0 conn(0x7f48e406bb10 msgr2=0x7f48e4071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 --2- 172.21.15.6:0/1799627132 >> v2:172.21.15.188:3300/0 conn(0x7f48e406bb10 0x7f48e4071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48e359e640 1 -- 172.21.15.6:0/1799627132 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e4072ce0 con 0x7f48e40a5650 2024-04-26T00:50:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.628+0000 7f48da59c640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e359e640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40a7430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e406f8b0 tx=0x7f48dc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ced24c8567ad9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e259c640 1 -- 172.21.15.6:0/1799627132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0a5650 con 0x7f48e40a5650 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e259c640 1 -- 172.21.15.6:0/1799627132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc0a57f0 con 0x7f48e40a5650 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e259c640 1 -- 172.21.15.6:0/1799627132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0a5bc0 con 0x7f48e40a5650 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 -- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 msgr2=0x7f48e40a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40a7430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48e406f8b0 tx=0x7f48dc01c9d0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 -- 172.21.15.6:0/1799627132 shutdown_connections 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40a7430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 --2- 172.21.15.6:0/1799627132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e4072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 --2- 172.21.15.6:0/1799627132 >> v2:172.21.15.188:3300/0 conn(0x7f48e406bb10 0x7f48e4071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 -- 172.21.15.6:0/1799627132 >> 172.21.15.6:0/1799627132 conn(0x7f48e406e400 msgr2=0x7f48e406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 -- 172.21.15.6:0/1799627132 shutdown_connections 2024-04-26T00:50:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.632+0000 7f48e9249640 1 -- 172.21.15.6:0/1799627132 wait complete. 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 Processor -- start 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- start start 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48e406bb10 0x7f48e40b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48e414e7b0 con 0x7f48e40a5650 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4137fe0 con 0x7f48e406bb10 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f48e414e930 con 0x7f48e4138380 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e359e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58082/0 (socket says 172.21.15.6:58082) 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e359e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51912/0 (socket says 172.21.15.6:51912) 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 -- 172.21.15.6:0/3212886012 learned_addr learned my addr 172.21.15.6:0/3212886012 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48e406bb10 0x7f48e40b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 -- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 msgr2=0x7f48e41df630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 -- 172.21.15.6:0/3212886012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48e406bb10 msgr2=0x7f48e40b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48e406bb10 0x7f48e40b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 -- 172.21.15.6:0/3212886012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e4142250 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e359e640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48da59c640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00e9e0 tx=0x7f48cc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48dbfff640 1 -- 172.21.15.6:0/3212886012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc017070 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48dbfff640 1 -- 172.21.15.6:0/3212886012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc00c9d0 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e41df1e0 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48dbfff640 1 -- 172.21.15.6:0/3212886012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00cdc0 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e40b6cc0 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48dbfff640 1 -- 172.21.15.6:0/3212886012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f48cc01a070 con 0x7f48e40a5650 2024-04-26T00:50:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.636+0000 7f48dbfff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48dbfff640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48dbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48dbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48dbfff640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 0x7f48c409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 Processor -- start 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 0x7f48c409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48dbfff640 1 -- 172.21.15.6:0/3212886012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f48cc0c1d80 con 0x7f48e40a5650 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- start start 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 0x7f48c409b800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48d400b9d0 tx=0x7f48d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 0x55651377b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55651365d4d0 con 0x5565137a6b50 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55651357cd50 con 0x55651377b2c0 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x5565135c46d0 con 0x5565137a6230 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58092/0 (socket says 172.21.15.6:58092) 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51918/0 (socket says 172.21.15.6:51918) 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 -- 172.21.15.6:0/1622207057 learned_addr learned my addr 172.21.15.6:0/1622207057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 -- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 msgr2=0x5565137a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e359e640 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 0x55651377b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 -- 172.21.15.6:0/1622207057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 msgr2=0x55651377b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 0x55651377b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 -- 172.21.15.6:0/1622207057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55651360a340 con 0x5565137a6b50 2024-04-26T00:50:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48e359e640 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 0x55651377b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48da59c640 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c07b0 tx=0x7f48cc0926d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81a7641822d2197 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48d8d99640 1 -- 172.21.15.6:0/1622207057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc021070 con 0x5565137a6b50 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48d8d99640 1 -- 172.21.15.6:0/1622207057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc0906b0 con 0x5565137a6b50 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48d8d99640 1 -- 172.21.15.6:0/1622207057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc08ec80 con 0x5565137a6b50 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 msgr2=0x55651377ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c07b0 tx=0x7f48cc0926d0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- 172.21.15.6:0/1622207057 shutdown_connections 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55651377b2c0 0x55651377b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x55651377ad80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/1622207057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- 172.21.15.6:0/1622207057 >> 172.21.15.6:0/1622207057 conn(0x556513772e60 msgr2=0x556513775250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- 172.21.15.6:0/1622207057 shutdown_connections 2024-04-26T00:50:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- 172.21.15.6:0/1622207057 wait complete. 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 -- start start 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.640+0000 7f48ec3c0000 1 Processor -- start 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6230 0x5565137b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x5565137ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5565135c0690 con 0x5565137a6b50 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55651354bdb0 con 0x5565137a6230 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x55651357e5b0 con 0x55651377b2c0 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 10 client.0 _ll_register_callbacks cb 0x556513761b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x5565137ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51930/0 (socket says 172.21.15.6:51930) 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 -- 172.21.15.6:0/3660870490 learned_addr learned my addr 172.21.15.6:0/3660870490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 -- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6230 msgr2=0x5565137b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6230 0x5565137b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 -- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 msgr2=0x5565137ba3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x5565137ba3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 -- 172.21.15.6:0/3660870490 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556513549d00 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48d4014740 tx=0x7f48d40046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=292c898b314290b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3301/0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4025070 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48cc0906b0 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mon.2 v2:172.21.15.6:3301/0 2 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f48d40159e0 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f48d4030050 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 10 client.4490 fetch_fsmap learned FSMap version 8 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55651354c000 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mon.2 v2:172.21.15.6:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc0906b0 con 0x55651377b2c0 2024-04-26T00:50:57.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mon.2 v2:172.21.15.6:3301/0 5 ==== fsmap(e 8) ==== 2889+0+0 (secure 0 0 0) 0x7f48d4033020 con 0x55651377b2c0 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 10 client.4490 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 10 client.4490 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 20 client.4490 populate_metadata read hostname 'smithi006' 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137bd300 0x5565137bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 4 client.4490 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 --> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55651355fa80 con 0x5565137bd300 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48da59c640 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137bd300 0x5565137bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48c1ffb640 10 client.4490 ms_handle_connect on v2:172.21.15.188:6824/3094432965 2024-04-26T00:50:57.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.644+0000 7f48da59c640 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137bd300 0x5565137bf6f0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5595121d055d71c4 server_cookie=bf84a4203c56e489 in_seq=0 out_seq=0 2024-04-26T00:50:57.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48c1ffb640 1 -- 172.21.15.6:0/3660870490 <== mds.0 v2:172.21.15.188:6824/3094432965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55651355fa80 con 0x5565137bd300 2024-04-26T00:50:57.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48c1ffb640 10 client.4490 handle_command_reply: tid=0 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 client.4490 shutdown 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 msgr2=0x5565137a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48d4014740 tx=0x7f48d40046d0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 shutdown_connections 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137bd300 0x5565137bf6f0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565137a6b50 0x5565137ba3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48c1ffb640 0 client.4490 ms_handle_reset on v2:172.21.15.188:6824/3094432965 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6230 0x5565137b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3660870490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x55651377b2c0 0x5565137a5cb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 >> 172.21.15.6:0/3660870490 conn(0x556513772e60 msgr2=0x556513775250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 shutdown_connections 2024-04-26T00:50:57.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3660870490 wait complete. 2024-04-26T00:50:57.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.648+0000 7f48ec3c0000 20 client.4490 trim_cache size 0 max 16384 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 Processor -- start 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 -- start start 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x556513776020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48e41e67f0 con 0x55651377b2c0 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4136a20 con 0x5565137a6b50 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f48e4137070 con 0x5565137a6230 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:51944/0 (socket says 172.21.15.6:51944) 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 -- 172.21.15.6:0/3434961347 learned_addr learned my addr 172.21.15.6:0/3434961347 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58110/0 (socket says 172.21.15.6:58110) 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 -- 172.21.15.6:0/3434961347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 msgr2=0x556513776020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x556513776020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 -- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 msgr2=0x5565137ba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 -- 172.21.15.6:0/3434961347 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565137a6980 con 0x5565137a6230 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48da59c640 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c20a0 tx=0x7f48cc009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f93006c79dedd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48c3fff640 1 -- 172.21.15.6:0/3434961347 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc09b280 con 0x5565137a6230 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48c3fff640 1 -- 172.21.15.6:0/3434961347 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc090910 con 0x5565137a6230 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.664+0000 7f48c3fff640 1 -- 172.21.15.6:0/3434961347 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc09adf0 con 0x5565137a6230 2024-04-26T00:50:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 msgr2=0x556513775ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c20a0 tx=0x7f48cc009f90 comp rx=0 tx=0).stop 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3434961347 shutdown_connections 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x556513776020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x556513775ae0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/3434961347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3434961347 >> 172.21.15.6:0/3434961347 conn(0x556513772e60 msgr2=0x55651377bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3434961347 shutdown_connections 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/3434961347 wait complete. 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- start start 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 Processor -- start 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137ef330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x5565137ef870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5565135669f0 con 0x55651377b2c0 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55651355c780 con 0x5565137a6b50 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x55651358ac60 con 0x5565137a6230 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 10 client.0 _ll_register_callbacks cb 0x7f48d400fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48da59c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58122/0 (socket says 172.21.15.6:58122) 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 -- 172.21.15.6:0/654980460 learned_addr learned my addr 172.21.15.6:0/654980460 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 -- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 msgr2=0x5565137ef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137ef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 -- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 msgr2=0x5565137ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x5565137ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 -- 172.21.15.6:0/654980460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556513591730 con 0x55651377b2c0 2024-04-26T00:50:57.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48da59c640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:50:57.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48e2d9d640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48d400f5b0 tx=0x7f48d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c4d9cc3a5c0ba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4025040 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f48d40159e0 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48cc090910 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f48d4043050 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 10 client.4593 fetch_fsmap learned FSMap version 8 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55651361d500 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc090910 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) ==== 2889+0+0 (secure 0 0 0) 0x7f48d4046020 con 0x55651377b2c0 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T00:50:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 10 client.4593 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 20 client.4593 populate_metadata read hostname 'smithi006' 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137efdb0 0x556513825650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 4 client.4593 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 --> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] -- command(tid 0: {"prefix": "status"}) -- 0x5565135d1c10 con 0x5565137efdb0 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48da59c640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137efdb0 0x556513825650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48c1ffb640 10 client.4593 ms_handle_connect on v2:172.21.15.188:6824/3094432965 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.668+0000 7f48da59c640 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137efdb0 0x556513825650 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1064ecc96257e137 server_cookie=cc857647ea1e6b17 in_seq=0 out_seq=0 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48c1ffb640 1 -- 172.21.15.6:0/654980460 <== mds.0 v2:172.21.15.188:6824/3094432965 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5565135d1c10 con 0x5565137efdb0 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48c1ffb640 10 client.4593 handle_command_reply: tid=0 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 client.4593 shutdown 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 msgr2=0x5565137c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f48d400f5b0 tx=0x7f48d4016000 comp rx=0 tx=0).stop 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 shutdown_connections 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:6824/3094432965,v1:172.21.15.188:6825/3094432965] conn(0x5565137efdb0 0x556513825650 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5565137a6b50 0x5565137ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48c1ffb640 0 client.4593 ms_handle_reset on v2:172.21.15.188:6824/3094432965 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5565137a6230 0x5565137ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 --2- 172.21.15.6:0/654980460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55651377b2c0 0x5565137c24c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 >> 172.21.15.6:0/654980460 conn(0x556513772e60 msgr2=0x556513775ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 shutdown_connections 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 1 -- 172.21.15.6:0/654980460 wait complete. 2024-04-26T00:50:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48ec3c0000 20 client.4593 trim_cache size 0 max 16384 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "67c57dbc-0204-4fdf-9da5-917e1a66c836", 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4243, 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 17.848069803000001, 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 20, 2024-04-26T00:50:57.689 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 20, 2024-04-26T00:50:57.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 22.797511961000001 2024-04-26T00:50:57.690 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-04-26T00:50:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 10 mgrc shutdown 2024-04-26T00:50:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 msgr2=0x7f48c409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 0x7f48c409b800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48d400b9d0 tx=0x7f48d4008040 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 msgr2=0x7f48e40ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00e9e0 tx=0x7f48cc00eea0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 shutdown_connections 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f48c4099340 0x7f48c409b800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e4138380 0x7f48e41df630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e40a5650 0x7f48e40ac900 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 --2- 172.21.15.6:0/3212886012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48e406bb10 0x7f48e40b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 >> 172.21.15.6:0/3212886012 conn(0x7f48e406e400 msgr2=0x7f48e40a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 shutdown_connections 2024-04-26T00:50:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:50:57.672+0000 7f48e9249640 1 -- 172.21.15.6:0/3212886012 wait complete. 2024-04-26T00:50:57.696 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T00:50:57.708 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-26T00:50:57.708 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T00:50:57.709 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T00:50:57.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:50:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T00:50:57.717 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T00:50:57.766 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-26T00:50:57.766 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-26T00:50:57.815 INFO:tasks.workunit:timeout=3h 2024-04-26T00:50:57.815 INFO:tasks.workunit:cleanup=True 2024-04-26T00:50:57.815 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-26T00:50:57.865 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T00:51:21.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:51:21.071 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:51:51.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:51:51.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T00:52:10.193 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-04-26T00:52:10.194 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-26T00:52:10.197 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T00:52:10.204 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T00:52:10.207 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T00:52:10.207 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T00:52:10.965 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T00:52:11.053 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T00:52:11.115 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T00:52:11.116 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T00:52:11.116 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T00:52:11.167 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T00:52:11.171 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-04-26T00:52:11.172 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T00:52:11.217 INFO:tasks.workunit:Running workunits matching mgr/test_localpool.sh on client.0... 2024-04-26T00:52:11.218 INFO:tasks.workunit:Running workunit mgr/test_localpool.sh... 2024-04-26T00:52:11.219 DEBUG:teuthology.orchestra.run.smithi006:workunit test mgr/test_localpool.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_localpool.sh 2024-04-26T00:52:11.269 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph config set mgr mgr/localpool/subtree host 2024-04-26T00:52:11.397 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 Processor -- start 2024-04-26T00:52:11.397 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 -- start start 2024-04-26T00:52:11.398 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f12800a60a0 0x7f12800b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800a75f0 con 0x7f1280144bc0 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f12800a78b0 con 0x7f12800a60a0 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1288771640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f12800a6480 con 0x7f12800a5940 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52328/0 (socket says 172.21.15.6:52328) 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 -- 172.21.15.6:0/3108677194 learned_addr learned my addr 172.21.15.6:0/3108677194 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f128650d640 1 --2- 172.21.15.6:0/3108677194 >> v2:172.21.15.188:3300/0 conn(0x7f12800a60a0 0x7f12800b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 -- 172.21.15.6:0/3108677194 >> v2:172.21.15.188:3300/0 conn(0x7f12800a60a0 msgr2=0x7f12800b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 --2- 172.21.15.6:0/3108677194 >> v2:172.21.15.188:3300/0 conn(0x7f12800a60a0 0x7f12800b8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 -- 172.21.15.6:0/3108677194 >> v1:172.21.15.188:6789/0 conn(0x7f1280144bc0 legacy=0x7f128006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:11.399 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.390+0000 7f1285d0c640 1 -- 172.21.15.6:0/3108677194 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12800724b0 con 0x7f12800a5940 2024-04-26T00:52:11.401 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1285d0c640 1 --2- 172.21.15.6:0/3108677194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1270006fd0 tx=0x7f127001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aac98eac825346a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.401 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f128550b640 1 -- 172.21.15.6:0/3108677194 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700b0070 con 0x7f12800a5940 2024-04-26T00:52:11.401 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f128550b640 1 -- 172.21.15.6:0/3108677194 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12700ab600 con 0x7f12800a5940 2024-04-26T00:52:11.401 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f128550b640 1 -- 172.21.15.6:0/3108677194 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700ab9d0 con 0x7f12800a5940 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- 172.21.15.6:0/3108677194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 msgr2=0x7f1280144680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- 172.21.15.6:0/3108677194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1270006fd0 tx=0x7f127001c420 comp rx=0 tx=0).stop 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- 172.21.15.6:0/3108677194 shutdown_connections 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- 172.21.15.6:0/3108677194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12800a5940 0x7f1280144680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- 172.21.15.6:0/3108677194 >> v2:172.21.15.188:3300/0 conn(0x7f12800a60a0 0x7f12800b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- 172.21.15.6:0/3108677194 >> 172.21.15.6:0/3108677194 conn(0x7f12800741c0 msgr2=0x7f12800745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- 172.21.15.6:0/3108677194 shutdown_connections 2024-04-26T00:52:11.402 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- 172.21.15.6:0/3108677194 wait complete. 2024-04-26T00:52:11.403 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 Processor -- start 2024-04-26T00:52:11.403 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- start start 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12800a5940 0x7f1280146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 0x7f12800a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 0x7f12800a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f128006c420 con 0x7f12800a60a0 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f128006c2a0 con 0x7f12800a5940 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1288771640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1280152a70 con 0x7f1280144bc0 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1286d0e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 0x7f12800a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1285d0c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 0x7f12800a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.405 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1286d0e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 0x7f12800a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52340/0 (socket says 172.21.15.6:52340) 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f1286d0e640 1 -- 172.21.15.6:0/3850769811 learned_addr learned my addr 172.21.15.6:0/3850769811 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.394+0000 7f128650d640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12800a5940 0x7f1280146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 -- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 msgr2=0x7f12800a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 0x7f12800a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 -- 172.21.15.6:0/3850769811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12800a5940 msgr2=0x7f1280146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.406 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12800a5940 0x7f1280146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.407 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280147b40 con 0x7f12800a60a0 2024-04-26T00:52:11.407 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1285d0c640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 0x7f12800a39e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12700ab000 tx=0x7f12700191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.408 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700b0040 con 0x7f12800a60a0 2024-04-26T00:52:11.408 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12700ab9b0 con 0x7f12800a60a0 2024-04-26T00:52:11.408 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700abd60 con 0x7f12800a60a0 2024-04-26T00:52:11.408 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1280147e00 con 0x7f12800a60a0 2024-04-26T00:52:11.408 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.398+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12800a2df0 con 0x7f12800a60a0 2024-04-26T00:52:11.409 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128006d9b0 con 0x7f12800a60a0 2024-04-26T00:52:11.410 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f12700bb060 con 0x7f12800a60a0 2024-04-26T00:52:11.410 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:52:11.410 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 0x7f126409b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7f127015ba80 con 0x7f12800a60a0 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f128650d640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 0x7f126409b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.411 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.402+0000 7f128650d640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 0x7f126409b800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12780070b0 tx=0x7f1278007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.414 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.406+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f12700160d0 con 0x7f12800a60a0 2024-04-26T00:52:11.569 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.562+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) -- 0x7f1280072290 con 0x7f12800a60a0 2024-04-26T00:52:11.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.566+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f127012c8e0 con 0x7f12800a60a0 2024-04-26T00:52:11.670 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.662+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) -- 0x7f1280072290 con 0x7f12800a60a0 2024-04-26T00:52:11.671 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.662+0000 7f1276ffd640 1 -- 172.21.15.6:0/3850769811 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f127012c1e0 con 0x7f12800a60a0 2024-04-26T00:52:11.674 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 10 mgrc shutdown 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 msgr2=0x7f126409b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 0x7f126409b800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12780070b0 tx=0x7f1278007040 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 msgr2=0x7f12800a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 0x7f12800a39e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12700ab000 tx=0x7f12700191c0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 shutdown_connections 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f1264099340 0x7f126409b800 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1280144bc0 0x7f12800a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12800a60a0 0x7f12800a39e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 --2- 172.21.15.6:0/3850769811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12800a5940 0x7f1280146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 >> 172.21.15.6:0/3850769811 conn(0x7f12800741c0 msgr2=0x7f128006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 shutdown_connections 2024-04-26T00:52:11.675 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.666+0000 7f1288771640 1 -- 172.21.15.6:0/3850769811 wait complete. 2024-04-26T00:52:11.687 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph config set mgr mgr/localpool/failure_domain osd 2024-04-26T00:52:11.805 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 Processor -- start 2024-04-26T00:52:11.806 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 -- start start 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f889c0a74d0 0x7f889c14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889c0a7960 con 0x7f889c0b6b40 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f889c0b6f20 con 0x7f889c0a74d0 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a2f6a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f889c0a6de0 con 0x7f889c06f890 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52356/0 (socket says 172.21.15.6:52356) 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 -- 172.21.15.6:0/429285642 learned_addr learned my addr 172.21.15.6:0/429285642 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:11.807 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f88a1507640 1 --2- 172.21.15.6:0/429285642 >> v2:172.21.15.6:3300/0 conn(0x7f889c0a74d0 0x7f889c14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.808 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 -- 172.21.15.6:0/429285642 >> v2:172.21.15.6:3300/0 conn(0x7f889c0a74d0 msgr2=0x7f889c14c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:11.808 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 --2- 172.21.15.6:0/429285642 >> v2:172.21.15.6:3300/0 conn(0x7f889c0a74d0 0x7f889c14c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.808 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 -- 172.21.15.6:0/429285642 >> v1:172.21.15.188:6789/0 conn(0x7f889c0b6b40 legacy=0x7f889c141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:11.808 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.798+0000 7f889bfff640 1 -- 172.21.15.6:0/429285642 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0a3200 con 0x7f889c06f890 2024-04-26T00:52:11.809 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f889bfff640 1 --2- 172.21.15.6:0/429285642 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888401c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3070fa71d106439 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.809 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f889b7fe640 1 -- 172.21.15.6:0/429285642 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88840b0070 con 0x7f889c06f890 2024-04-26T00:52:11.809 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f889b7fe640 1 -- 172.21.15.6:0/429285642 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88840ab600 con 0x7f889c06f890 2024-04-26T00:52:11.809 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f889b7fe640 1 -- 172.21.15.6:0/429285642 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88840ab9d0 con 0x7f889c06f890 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- 172.21.15.6:0/429285642 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 msgr2=0x7f889c0a89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/429285642 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888401c290 comp rx=0 tx=0).stop 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- 172.21.15.6:0/429285642 shutdown_connections 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/429285642 >> v2:172.21.15.6:3300/0 conn(0x7f889c0a74d0 0x7f889c14c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/429285642 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c06f890 0x7f889c0a89b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- 172.21.15.6:0/429285642 >> 172.21.15.6:0/429285642 conn(0x7f889c06b360 msgr2=0x7f889c06b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:11.810 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- 172.21.15.6:0/429285642 shutdown_connections 2024-04-26T00:52:11.811 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- 172.21.15.6:0/429285642 wait complete. 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 Processor -- start 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- start start 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 0x7f889c140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 0x7f889c1e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f889c14d6c0 con 0x7f889c1388a0 2024-04-26T00:52:11.813 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f889c14d540 con 0x7f889c0b6b40 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a2f6a640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f889c14d840 con 0x7f889c0a74d0 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a0d06640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a1507640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 0x7f889c1e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a0d06640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52360/0 (socket says 172.21.15.6:52360) 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.802+0000 7f88a0d06640 1 -- 172.21.15.6:0/78734896 learned_addr learned my addr 172.21.15.6:0/78734896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f889bfff640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 0x7f889c140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 -- 172.21.15.6:0/78734896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 msgr2=0x7f889c140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 0x7f889c140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 -- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 msgr2=0x7f889c1e0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 0x7f889c1e0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c138170 con 0x7f889c0a74d0 2024-04-26T00:52:11.814 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a1507640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 0x7f889c1e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f889bfff640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 0x7f889c140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a0d06640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b410 tx=0x7f888c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c015030 con 0x7f889c0a74d0 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c004020 con 0x7f889c0a74d0 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c004450 con 0x7f889c0a74d0 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c141220 con 0x7f889c0a74d0 2024-04-26T00:52:11.815 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c071d40 con 0x7f889c0a74d0 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c068d20 con 0x7f889c0a74d0 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7f888c018070 con 0x7f889c0a74d0 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:11.816 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:11.817 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 0x7f887c09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:11.817 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f889bfff640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 0x7f887c09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:11.817 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7f888c0c2600 con 0x7f889c0a74d0 2024-04-26T00:52:11.817 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.806+0000 7f889bfff640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 0x7f887c09b800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88840ad000 tx=0x7f8884008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:11.818 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.810+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f889c138170 con 0x7f889c0a74d0 2024-04-26T00:52:11.983 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.974+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) -- 0x7f889c0a4f40 con 0x7f889c0a74d0 2024-04-26T00:52:11.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:11.986+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) ==== 128+0+0 (secure 0 0 0) 0x7f888c093500 con 0x7f889c0a74d0 2024-04-26T00:52:12.089 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.082+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) -- 0x7f889c0a4a10 con 0x7f889c0a74d0 2024-04-26T00:52:12.090 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.082+0000 7f88997fa640 1 -- 172.21.15.6:0/78734896 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) ==== 128+0+0 (secure 0 0 0) 0x7f888c092e00 con 0x7f889c0a74d0 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 10 mgrc shutdown 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 msgr2=0x7f887c09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 0x7f887c09b800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88840ad000 tx=0x7f8884008040 comp rx=0 tx=0).stop 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 msgr2=0x7f889c14e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b410 tx=0x7f888c00b8d0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 shutdown_connections 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7f887c099340 0x7f887c09b800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889c1388a0 0x7f889c1e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.093 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f889c0b6b40 0x7f889c140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.094 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 --2- 172.21.15.6:0/78734896 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f889c0a74d0 0x7f889c14e010 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.094 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 >> 172.21.15.6:0/78734896 conn(0x7f889c06b360 msgr2=0x7f889c0a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:12.094 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 shutdown_connections 2024-04-26T00:52:12.094 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.086+0000 7f88a2f6a640 1 -- 172.21.15.6:0/78734896 wait complete. 2024-04-26T00:52:12.107 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph mgr module enable localpool 2024-04-26T00:52:12.230 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 Processor -- start 2024-04-26T00:52:12.230 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 -- start start 2024-04-26T00:52:12.232 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 0x7fcbf40a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.232 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbf414b780 0x7fcbf414db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.232 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf40a3ac0 con 0x7fcbf40a2820 2024-04-26T00:52:12.232 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf40a1470 con 0x7fcbf414b780 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbfb9cd640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40a3d80 con 0x7fcbf40a0810 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbf414b780 0x7fcbf414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9769640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 0x7fcbf40a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbf414b780 0x7fcbf414db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56680/0 (socket says 172.21.15.6:56680) 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9769640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 0x7fcbf40a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52370/0 (socket says 172.21.15.6:52370) 2024-04-26T00:52:12.233 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/2009513166 learned_addr learned my addr 172.21.15.6:0/2009513166 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:12.234 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 msgr2=0x7fcbf40a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:12.234 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 0x7fcbf40a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.234 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/2009513166 >> v1:172.21.15.188:6789/0 conn(0x7fcbf40a2820 legacy=0x7fcbf41436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:12.234 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.222+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/2009513166 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf40a02d0 con 0x7fcbf414b780 2024-04-26T00:52:12.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf414b780 0x7fcbf414db70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009e50 tx=0x7fcbec01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94696b70587603cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:12.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbebfff640 1 -- 172.21.15.6:0/2009513166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0a5820 con 0x7fcbf414b780 2024-04-26T00:52:12.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbebfff640 1 -- 172.21.15.6:0/2009513166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec0a59c0 con 0x7fcbf414b780 2024-04-26T00:52:12.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbebfff640 1 -- 172.21.15.6:0/2009513166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0a5d90 con 0x7fcbf414b780 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf414b780 msgr2=0x7fcbf414db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf414b780 0x7fcbf414db70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009e50 tx=0x7fcbec01c980 comp rx=0 tx=0).stop 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/2009513166 shutdown_connections 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf414b780 0x7fcbf414db70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/2009513166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf40a0810 0x7fcbf40a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.242 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/2009513166 >> 172.21.15.6:0/2009513166 conn(0x7fcbf406bda0 msgr2=0x7fcbf40a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/2009513166 shutdown_connections 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/2009513166 wait complete. 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 Processor -- start 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.226+0000 7fcbfb9cd640 1 -- start start 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.243 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbf40a2820 0x7fcbf414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 0x7fcbf41e0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf406c780 con 0x7fcbf40a0810 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40a0ce0 con 0x7fcbf40a2820 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf406c900 con 0x7fcbf414b780 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9769640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.244 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9769640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56684/0 (socket says 172.21.15.6:56684) 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 learned_addr learned my addr 172.21.15.6:0/3735291506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 0x7fcbf41e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf8f68640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbf40a2820 0x7fcbf414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbf40a2820 msgr2=0x7fcbf414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbf40a2820 0x7fcbf414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.245 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 msgr2=0x7fcbf413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf40709a0 con 0x7fcbf414b780 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbf9f6a640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 0x7fcbf41e0800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0ab000 tx=0x7fcbec019720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0bc070 con 0x7fcbf414b780 2024-04-26T00:52:12.246 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec0b8640 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf414dcf0 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec009510 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf4070100 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf4068d20 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 5) ==== 130837+0+0 (secure 0 0 0) 0x7fcbec0b8a30 con 0x7fcbf414b780 2024-04-26T00:52:12.247 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.230+0000 7fcbe9ffb640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.234+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7fcbec15d440 con 0x7fcbf414b780 2024-04-26T00:52:12.248 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.234+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:12.249 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.234+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0011310 tx=0x7fcbf0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:12.249 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.234+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcbec016600 con 0x7fcbf414b780 2024-04-26T00:52:12.448 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:12.442+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) -- 0x7fcbf406d250 con 0x7fcbf414b780 2024-04-26T00:52:13.018 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.010+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 6) ==== 130850+0+0 (secure 0 0 0) 0x7fcbec12a340 con 0x7fcbf414b780 2024-04-26T00:52:13.019 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.010+0000 7fcbe9ffb640 20 mgrc handle_mgr_map mgrmap(e 6) 2024-04-26T00:52:13.019 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.010+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Got map version 6 2024-04-26T00:52:13.019 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.010+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:13.019 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.010+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 v6) ==== 88+0+0 (secure 0 0 0) 0x7fcbec15fcd0 con 0x7fcbf414b780 2024-04-26T00:52:13.045 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbd809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:52:13.045 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbd809b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:52:13.045 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0011310 tx=0x7fcbf0009190 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0011310 tx=0x7fcbf0009190 comp rx=0 tx=0).stop 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbe9ffb640 4 mgrc ms_handle_reset ms_handle_reset con 0x7fcbd8099340 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbe9ffb640 4 mgrc reconnect Terminating session with v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbd809b800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbe9ffb640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbd809b800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:13.046 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.038+0000 7fcbe9ffb640 4 mgrc reconnect waiting to retry connect until 738.059919s 2024-04-26T00:52:13.149 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:13.142+0000 7f24f0b8b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:13.159 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:13.150+0000 7fb716252180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:13.161 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:13.154+0000 7fa432f2f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:13.172 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.166+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) -- 0x7fcbcc0050b0 con 0x7fcbf414b780 2024-04-26T00:52:13.240 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.234+0000 7fcbdffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:13.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.234+0000 7fcbdffff640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:13.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.234+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbf40a3f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:13.241 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.234+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:13.444 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.438+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbf40a3f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:13.444 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.438+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:13.534 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:13.526+0000 7fa432f2f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:13.538 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:13.530+0000 7f24f0b8b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:13.542 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:13.534+0000 7fb716252180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:13.666 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:13.658+0000 7fa432f2f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:13.673 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:13.666+0000 7f24f0b8b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:13.674 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:13.666+0000 7fb716252180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:13.848 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.842+0000 7fcbf9769640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbf40a3f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:13.848 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:13.842+0000 7fcbf9769640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T00:52:14.016 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.010+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 9 ==== mgrmap(e 7) ==== 130850+0+0 (secure 0 0 0) 0x7fcbec11bd10 con 0x7fcbf414b780 2024-04-26T00:52:14.016 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.010+0000 7fcbe9ffb640 20 mgrc handle_mgr_map mgrmap(e 7) 2024-04-26T00:52:14.017 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.010+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Got map version 7 2024-04-26T00:52:14.017 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.010+0000 7fcbe9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:14.019 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.010+0000 7fcbe9ffb640 1 -- 172.21.15.6:0/3735291506 <== mon.2 v2:172.21.15.6:3301/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 module 'localpool' is already enabled v7) ==== 125+0+0 (secure 0 0 0) 0x7fcbec12e460 con 0x7fcbf414b780 2024-04-26T00:52:14.019 INFO:tasks.workunit.client.0.smithi006.stderr:module 'localpool' is already enabled 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 10 mgrc shutdown 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 msgr2=0x7fcbf40a3f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 msgr2=0x7fcbf41e0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 0x7fcbf41e0800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0ab000 tx=0x7fcbec019720 comp rx=0 tx=0).stop 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 shutdown_connections 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7fcbd8099340 0x7fcbf40a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcbf414b780 0x7fcbf41e0800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbf40a2820 0x7fcbf414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.023 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 --2- 172.21.15.6:0/3735291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbf40a0810 0x7fcbf413c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.024 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 >> 172.21.15.6:0/3735291506 conn(0x7fcbf406bda0 msgr2=0x7fcbf41434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:14.024 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 shutdown_connections 2024-04-26T00:52:14.024 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.014+0000 7fcbfb9cd640 1 -- 172.21.15.6:0/3735291506 wait complete. 2024-04-26T00:52:14.039 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph osd pool ls 2024-04-26T00:52:14.039 INFO:tasks.workunit.client.0.smithi006.stderr:+ grep ^by-host- 2024-04-26T00:52:14.088 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.082+0000 7fa432f2f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:14.104 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.098+0000 7fb716252180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:14.112 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.106+0000 7f24f0b8b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:14.140 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.134+0000 7fa432f2f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:14.149 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 Processor -- start 2024-04-26T00:52:14.149 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 -- start start 2024-04-26T00:52:14.150 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f406b3f0 0x7ff7f4070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.150 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7f40a4c50 0x7ff7f414d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.150 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f40a5060 con 0x7ff7f40a47e0 2024-04-26T00:52:14.150 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f40717e0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f9c35640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f406b7d0 con 0x7ff7f40a4c50 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f406b3f0 0x7ff7f4070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7f406b3f0 0x7ff7f4070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56720/0 (socket says 172.21.15.6:56720) 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 -- 172.21.15.6:0/437730854 learned_addr learned my addr 172.21.15.6:0/437730854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f3fff640 1 --2- 172.21.15.6:0/437730854 >> v2:172.21.15.188:3300/0 conn(0x7ff7f40a4c50 0x7ff7f414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 -- 172.21.15.6:0/437730854 >> v2:172.21.15.188:3300/0 conn(0x7ff7f40a4c50 msgr2=0x7ff7f414d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/437730854 >> v2:172.21.15.188:3300/0 conn(0x7ff7f40a4c50 0x7ff7f414d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 -- 172.21.15.6:0/437730854 >> v1:172.21.15.188:6789/0 conn(0x7ff7f40a47e0 legacy=0x7ff7f41435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.151 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.142+0000 7ff7f37fe640 1 -- 172.21.15.6:0/437730854 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f40a52f0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.152 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/437730854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f4070d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7f406f1a0 tx=0x7ff7e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4a0e329caf0319 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:14.152 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f27fc640 1 -- 172.21.15.6:0/437730854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80b0070 con 0x7ff7f406b3f0 2024-04-26T00:52:14.153 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f27fc640 1 -- 172.21.15.6:0/437730854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e80ab600 con 0x7ff7f406b3f0 2024-04-26T00:52:14.153 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f27fc640 1 -- 172.21.15.6:0/437730854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80ab9d0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.153 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/437730854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 msgr2=0x7ff7f4070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.153 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/437730854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f4070d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7f406f1a0 tx=0x7ff7e801c470 comp rx=0 tx=0).stop 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/437730854 shutdown_connections 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/437730854 >> v2:172.21.15.188:3300/0 conn(0x7ff7f40a4c50 0x7ff7f414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/437730854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f4070d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/437730854 >> 172.21.15.6:0/437730854 conn(0x7ff7f40a69e0 msgr2=0x7ff7f40a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/437730854 shutdown_connections 2024-04-26T00:52:14.154 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/437730854 wait complete. 2024-04-26T00:52:14.156 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 Processor -- start 2024-04-26T00:52:14.156 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- start start 2024-04-26T00:52:14.156 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.156 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f40a47e0 0x7ff7f414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40a5fd0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40a5e50 con 0x7ff7f40a47e0 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f4143cd0 con 0x7ff7f40a4c50 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:52396/0 (socket says 172.21.15.6:52396) 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f3fff640 1 -- 172.21.15.6:0/3756811257 learned_addr learned my addr 172.21.15.6:0/3756811257 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f2ffd640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f40a47e0 0x7ff7f414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 msgr2=0x7ff7f413a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f40a47e0 msgr2=0x7ff7f414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.157 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f40a47e0 0x7ff7f414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f4149000 con 0x7ff7f406b3f0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f3fff640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f37fe640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f41427f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff7f406ba50 tx=0x7ff7e8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80b0040 con 0x7ff7f406b3f0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e80b9070 con 0x7ff7f406b3f0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.146+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f41492c0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80b4880 con 0x7ff7f406b3f0 2024-04-26T00:52:14.158 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f4148c30 con 0x7ff7f406b3f0 2024-04-26T00:52:14.159 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.150+0000 7fb716252180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:14.159 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f40687d0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 7) ==== 130850+0+0 (secure 0 0 0) 0x7ff7e80ab480 con 0x7ff7f406b3f0 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 20 mgrc handle_mgr_map mgrmap(e 7) 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 4 mgrc handle_mgr_map Got map version 7 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 0x7ff7e009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7f2ffd640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 msgr2=0x7ff7e009b880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7ff7e815ca00 con 0x7ff7f406b3f0 2024-04-26T00:52:14.160 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.150+0000 7ff7f2ffd640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 0x7ff7e009b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:14.162 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.154+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff7e80160f0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.168 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.158+0000 7f24f0b8b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:14.190 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.182+0000 7fa432f2f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:14.207 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.202+0000 7fb716252180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:14.219 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.210+0000 7f24f0b8b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:14.264 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.258+0000 7fa432f2f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:14.284 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.278+0000 7fb716252180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:14.297 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.290+0000 7f24f0b8b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:14.315 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.306+0000 7fa432f2f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:14.325 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.318+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7ff7f40b7530 con 0x7ff7f406b3f0 2024-04-26T00:52:14.326 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.318+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) ==== 59+0+37 (secure 0 0 0) 0x7ff7e812d860 con 0x7ff7f406b3f0 2024-04-26T00:52:14.334 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.326+0000 7fb716252180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:14.349 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.342+0000 7f24f0b8b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:14.360 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.354+0000 7ff7f2ffd640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 msgr2=0x7ff7e009b880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/3851499451 2024-04-26T00:52:14.360 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.354+0000 7ff7f2ffd640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 0x7ff7e009b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:14.389 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.382+0000 7fa432f2f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:14.410 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.402+0000 7fb716252180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:14.418 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.410+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7ff7f406edd0 con 0x7ff7f406b3f0 2024-04-26T00:52:14.418 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.410+0000 7ff7dbfff640 1 -- 172.21.15.6:0/3756811257 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) ==== 59+0+37 (secure 0 0 0) 0x7ff7e812d160 con 0x7ff7f406b3f0 2024-04-26T00:52:14.421 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 10 mgrc shutdown 2024-04-26T00:52:14.421 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 msgr2=0x7ff7e009b880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 0x7ff7e009b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 msgr2=0x7ff7f41427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f41427f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff7f406ba50 tx=0x7ff7e8019210 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 shutdown_connections 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:6808/3851499451,v1:172.21.15.6:6809/3851499451] conn(0x7ff7e00993c0 0x7ff7e009b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7f40a4c50 0x7ff7f413a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f40a47e0 0x7ff7f414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 --2- 172.21.15.6:0/3756811257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7f406b3f0 0x7ff7f41427f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 >> 172.21.15.6:0/3756811257 conn(0x7ff7f40a69e0 msgr2=0x7ff7f406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 shutdown_connections 2024-04-26T00:52:14.422 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:14.414+0000 7ff7f9c35640 1 -- 172.21.15.6:0/3756811257 wait complete. 2024-04-26T00:52:14.426 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.418+0000 7f24f0b8b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:14.437 INFO:tasks.workunit.client.0.smithi006.stderr:+ sleep 5 2024-04-26T00:52:14.439 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.430+0000 7fa432f2f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:14.461 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.454+0000 7fb716252180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:14.479 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.470+0000 7f24f0b8b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:14.582 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.574+0000 7fa432f2f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:14.605 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.598+0000 7fb716252180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:14.624 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.618+0000 7f24f0b8b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:14.633 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.626+0000 7fa432f2f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:14.658 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.650+0000 7fb716252180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:14.678 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.670+0000 7f24f0b8b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:14.863 INFO:tasks.ceph.mgr.z.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:14.863 INFO:tasks.ceph.mgr.z.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:14.863 INFO:tasks.ceph.mgr.z.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:14.879 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:14.874+0000 7fa432f2f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:14.907 INFO:tasks.ceph.mgr.x.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:14.907 INFO:tasks.ceph.mgr.x.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:14.907 INFO:tasks.ceph.mgr.x.smithi006.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:14.915 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:14.906+0000 7f24f0b8b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:14.926 INFO:tasks.ceph.mgr.y.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:14.926 INFO:tasks.ceph.mgr.y.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:14.927 INFO:tasks.ceph.mgr.y.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:14.940 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:14.934+0000 7fb716252180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:15.053 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.046+0000 7f24f0b8b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.055 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.050+0000 7fa432f2f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.098 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.090+0000 7fb716252180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.166 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.158+0000 7fa432f2f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:15.166 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.158+0000 7f24f0b8b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:15.216 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.210+0000 7fb716252180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:15.228 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.222+0000 7fa432f2f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:15.229 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.222+0000 7f24f0b8b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:15.281 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.274+0000 7fb716252180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:15.362 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.354+0000 7fa432f2f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.367 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.358+0000 7f24f0b8b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.416 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.410+0000 7fb716252180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:15.843 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.838+0000 7fa432f2f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:15.861 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.854+0000 7f24f0b8b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:15.910 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.902+0000 7fb716252180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:15.922 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:15.914+0000 7fa432f2f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:15.938 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:15.930+0000 7f24f0b8b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:15.986 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:15.978+0000 7fb716252180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:16.067 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:16.062+0000 7fa432f2f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:16.088 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.078+0000 7f24f0b8b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:16.134 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:16.126+0000 7fb716252180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:16.141 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:16.134+0000 7fa432f2f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:16.163 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.154+0000 7f24f0b8b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:16.208 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:16.202+0000 7fb716252180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:16.424 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:16.418+0000 7fa432f2f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:16.454 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.446+0000 7f24f0b8b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:16.479 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:16.470+0000 7fa432f2f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:16.497 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:16.490+0000 7fb716252180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:16.511 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.502+0000 7f24f0b8b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:16.556 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:16.550+0000 7fb716252180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f2478e93640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f2478e93640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f2478e93640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f2478e93640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f2478e93640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f247ae97640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f247ae97640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f247ae97640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.631 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f247ae97640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:16.632 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:16.622+0000 7f247ae97640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:19.438 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph osd pool ls 2024-04-26T00:52:19.439 INFO:tasks.workunit.client.0.smithi006.stderr:+ grep ^by-host- 2024-04-26T00:52:19.565 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 Processor -- start 2024-04-26T00:52:19.566 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 -- start start 2024-04-26T00:52:19.567 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 0x7f8c240a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.567 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c240a1610 con 0x7f8c240745a0 2024-04-26T00:52:19.567 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c240a2000 con 0x7f8c240a0230 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c2bb14640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8c240a0ee0 con 0x7f8c240741c0 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c290af640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c240745a0 0x7f8c241425e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45264/0 (socket says 172.21.15.6:45264) 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c290af640 1 -- 172.21.15.6:0/2257204737 learned_addr learned my addr 172.21.15.6:0/2257204737 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c298b0640 1 --2- 172.21.15.6:0/2257204737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 0x7f8c240a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c288ae640 1 -- 172.21.15.6:0/2257204737 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118090681 0 0) 0x7f8c240a1610 con 0x7f8c240745a0 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c288ae640 1 -- 172.21.15.6:0/2257204737 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003530 con 0x7f8c240745a0 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c298b0640 1 -- 172.21.15.6:0/2257204737 >> v1:172.21.15.188:6789/0 conn(0x7f8c240a0230 legacy=0x7f8c2414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c298b0640 1 -- 172.21.15.6:0/2257204737 >> v1:172.21.15.6:6789/0 conn(0x7f8c240745a0 legacy=0x7f8c241425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.568 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.558+0000 7f8c298b0640 1 -- 172.21.15.6:0/2257204737 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c24146900 con 0x7f8c240741c0 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c298b0640 1 --2- 172.21.15.6:0/2257204737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 0x7f8c240a1ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c140097f0 tx=0x7f8c1401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e302a5fdf9bc05e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c288ae640 1 -- 172.21.15.6:0/2257204737 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140b5070 con 0x7f8c240741c0 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c288ae640 1 -- 172.21.15.6:0/2257204737 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c140a89b0 con 0x7f8c240741c0 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c288ae640 1 -- 172.21.15.6:0/2257204737 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140a8d80 con 0x7f8c240741c0 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2257204737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 msgr2=0x7f8c240a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2257204737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 0x7f8c240a1ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c140097f0 tx=0x7f8c1401ecb0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2257204737 shutdown_connections 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2257204737 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c240741c0 0x7f8c240a1ac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2257204737 >> 172.21.15.6:0/2257204737 conn(0x7f8c2406b790 msgr2=0x7f8c240a5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2257204737 shutdown_connections 2024-04-26T00:52:19.570 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2257204737 wait complete. 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 Processor -- start 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- start start 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c240741c0 0x7f8c240b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c240a40f0 con 0x7f8c240a0230 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24146bc0 con 0x7f8c240741c0 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2bb14640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8c240a3df0 con 0x7f8c241dde00 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c290af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.573 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2a0b1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c290af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44888/0 (socket says 172.21.15.6:44888) 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c2a0b1640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38348/0 (socket says 172.21.15.6:38348) 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c290af640 1 -- 172.21.15.6:0/2779325474 learned_addr learned my addr 172.21.15.6:0/2779325474 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.562+0000 7f8c298b0640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c240741c0 0x7f8c240b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 -- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 msgr2=0x7f8c241d96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 -- 172.21.15.6:0/2779325474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c240741c0 msgr2=0x7f8c240b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c240741c0 0x7f8c240b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c241de290 con 0x7f8c240a0230 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c2a0b1640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:19.574 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c290af640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000cbc0 tx=0x7f8c2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:19.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20017070 con 0x7f8c240a0230 2024-04-26T00:52:19.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2000ad40 con 0x7f8c240a0230 2024-04-26T00:52:19.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c241de550 con 0x7f8c240a0230 2024-04-26T00:52:19.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20012600 con 0x7f8c240a0230 2024-04-26T00:52:19.575 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c24072fc0 con 0x7f8c240a0230 2024-04-26T00:52:19.576 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c240687d0 con 0x7f8c240a0230 2024-04-26T00:52:19.576 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 10) ==== 130896+0+0 (secure 0 0 0) 0x7f8c2001a070 con 0x7f8c240a0230 2024-04-26T00:52:19.576 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 20 mgrc handle_mgr_map mgrmap(e 10) 2024-04-26T00:52:19.576 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 4 mgrc handle_mgr_map Got map version 10 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 0x7f8c0809b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c298b0640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 0x7f8c0809b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.566+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5166+0+0 (secure 0 0 0) 0x7f8c200c2960 con 0x7f8c240a0230 2024-04-26T00:52:19.577 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.570+0000 7f8c298b0640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 0x7f8c0809b8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c140b2000 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4523 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:19.579 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.570+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8c20092e70 con 0x7f8c240a0230 2024-04-26T00:52:19.761 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.754+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f8c240a4350 con 0x7f8c240a0230 2024-04-26T00:52:19.762 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.754+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) ==== 59+0+55 (secure 0 0 0) 0x7f8c20097170 con 0x7f8c240a0230 2024-04-26T00:52:19.856 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f8c240ab460 con 0x7f8c240a0230 2024-04-26T00:52:19.857 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c1a7fc640 1 -- 172.21.15.6:0/2779325474 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) ==== 59+0+55 (secure 0 0 0) 0x7f8c2009ba30 con 0x7f8c240a0230 2024-04-26T00:52:19.859 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 10 mgrc shutdown 2024-04-26T00:52:19.859 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 msgr2=0x7f8c0809b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.859 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 0x7f8c0809b8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c140b2000 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2024-04-26T00:52:19.859 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 msgr2=0x7f8c241dd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.859 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000cbc0 tx=0x7f8c2000a430 comp rx=0 tx=0).stop 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 shutdown_connections 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8c08099420 0x7f8c0809b8e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c241dde00 0x7f8c241d96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c240a0230 0x7f8c241dd8c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 --2- 172.21.15.6:0/2779325474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c240741c0 0x7f8c240b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 >> 172.21.15.6:0/2779325474 conn(0x7f8c2406b790 msgr2=0x7f8c2409f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 shutdown_connections 2024-04-26T00:52:19.860 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.850+0000 7f8c2bb14640 1 -- 172.21.15.6:0/2779325474 wait complete. 2024-04-26T00:52:19.874 INFO:tasks.workunit.client.0.smithi006.stdout:by-host-smithi006 2024-04-26T00:52:19.875 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph mgr module disable localpool 2024-04-26T00:52:19.993 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 Processor -- start 2024-04-26T00:52:19.993 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 -- start start 2024-04-26T00:52:19.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 0x7f34f00a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 0x7f34f014db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:19.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f00a3ac0 con 0x7f34f00a2820 2024-04-26T00:52:19.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f34f00a1470 con 0x7f34f014b780 2024-04-26T00:52:19.994 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f75ed640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f34f00a3d80 con 0x7f34f00a0810 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5389640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 0x7f34f00a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f4b88640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34f00a2820 0x7f34f01436e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45266/0 (socket says 172.21.15.6:45266) 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f4b88640 1 -- 172.21.15.6:0/2342210129 learned_addr learned my addr 172.21.15.6:0/2342210129 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5b8a640 1 --2- 172.21.15.6:0/2342210129 >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 0x7f34f014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5389640 1 -- 172.21.15.6:0/2342210129 >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 msgr2=0x7f34f014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5389640 1 --2- 172.21.15.6:0/2342210129 >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 0x7f34f014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5389640 1 -- 172.21.15.6:0/2342210129 >> v1:172.21.15.6:6789/0 conn(0x7f34f00a2820 legacy=0x7f34f01436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5389640 1 -- 172.21.15.6:0/2342210129 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f00a02d0 con 0x7f34f00a0810 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34e7fff640 1 -- 172.21.15.6:0/2342210129 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086118906 0 0) 0x7f34f00a3ac0 con 0x7f34f00a2820 2024-04-26T00:52:19.995 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.986+0000 7f34f5b8a640 1 --2- 172.21.15.6:0/2342210129 >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 0x7f34f014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:19.996 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5389640 1 --2- 172.21.15.6:0/2342210129 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 0x7f34f00a1c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097c0 tx=0x7f34ec01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb73d9071790bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:19.996 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e7fff640 1 -- 172.21.15.6:0/2342210129 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0b1070 con 0x7f34f00a0810 2024-04-26T00:52:19.996 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e7fff640 1 -- 172.21.15.6:0/2342210129 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec0ac630 con 0x7f34f00a0810 2024-04-26T00:52:19.996 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e7fff640 1 -- 172.21.15.6:0/2342210129 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0a8050 con 0x7f34f00a0810 2024-04-26T00:52:19.997 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/2342210129 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 msgr2=0x7f34f00a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:19.997 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- 172.21.15.6:0/2342210129 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 0x7f34f00a1c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097c0 tx=0x7f34ec01c3f0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.997 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/2342210129 shutdown_connections 2024-04-26T00:52:19.997 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- 172.21.15.6:0/2342210129 >> v2:172.21.15.188:3300/0 conn(0x7f34f014b780 0x7f34f014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.998 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- 172.21.15.6:0/2342210129 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a0810 0x7f34f00a1c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:19.998 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/2342210129 >> 172.21.15.6:0/2342210129 conn(0x7f34f006bda0 msgr2=0x7f34f00a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:19.998 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/2342210129 shutdown_connections 2024-04-26T00:52:19.998 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/2342210129 wait complete. 2024-04-26T00:52:20.000 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 Processor -- start 2024-04-26T00:52:20.000 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- start start 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34f014b780 0x7f34f0139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34f006c780 con 0x7f34f00a0810 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34f00a0d30 con 0x7f34f014b780 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f34f006c900 con 0x7f34f00a2820 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5389640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5389640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44894/0 (socket says 172.21.15.6:44894) 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38356/0 (socket says 172.21.15.6:38356) 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 learned_addr learned my addr 172.21.15.6:0/3994012062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:20.001 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5b8a640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34f014b780 0x7f34f0139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34f014b780 msgr2=0x7f34f0139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34f014b780 0x7f34f0139950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 msgr2=0x7f34f014d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f0146720 con 0x7f34f00a2820 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f4b88640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c430 tx=0x7f34e000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e00074e0 con 0x7f34f00a2820 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e00047f0 con 0x7f34f00a2820 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f01469e0 con 0x7f34f00a2820 2024-04-26T00:52:20.002 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004be0 con 0x7f34f00a2820 2024-04-26T00:52:20.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.990+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f013fbc0 con 0x7f34f00a2820 2024-04-26T00:52:20.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f0068d20 con 0x7f34f00a2820 2024-04-26T00:52:20.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 10) ==== 130896+0+0 (secure 0 0 0) 0x7f34e0011070 con 0x7f34f00a2820 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 20 mgrc handle_mgr_map mgrmap(e 10) 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 4 mgrc handle_mgr_map Got map version 10 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5166+0+0 (secure 0 0 0) 0x7f34e00c2880 con 0x7f34f00a2820 2024-04-26T00:52:20.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.994+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34ec01cc90 tx=0x7f34ec008040 comp rx=0 tx=0).ready entity=mgr.4523 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:20.005 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:19.998+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f34e00934e0 con 0x7f34f00a2820 2024-04-26T00:52:20.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.202+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) -- 0x7f34f013f9a0 con 0x7f34f00a2820 2024-04-26T00:52:20.645 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.634+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 11) ==== 130939+0+0 (secure 0 0 0) 0x7f34e008f450 con 0x7f34f00a2820 2024-04-26T00:52:20.645 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.634+0000 7f34e5ffb640 20 mgrc handle_mgr_map mgrmap(e 11) 2024-04-26T00:52:20.645 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.638+0000 7f34e5ffb640 4 mgrc handle_mgr_map Got map version 11 2024-04-26T00:52:20.645 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.638+0000 7f34e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:20.646 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.638+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 v11) ==== 89+0+0 (secure 0 0 0) 0x7f34e0053bc0 con 0x7f34f00a2820 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34d409b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34d409b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34ec01cc90 tx=0x7f34ec008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34ec01cc90 tx=0x7f34ec008040 comp rx=0 tx=0).stop 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34e5ffb640 4 mgrc ms_handle_reset ms_handle_reset con 0x7f34d4099420 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34e5ffb640 4 mgrc reconnect Terminating session with v2:172.21.15.6:6808/346340426 2024-04-26T00:52:20.677 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34d409b8e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:52:20.678 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34e5ffb640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34d409b8e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:20.678 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.670+0000 7f34e5ffb640 4 mgrc reconnect waiting to retry connect until 745.822211s 2024-04-26T00:52:20.767 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:20.762+0000 7f5998b81180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:20.769 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:20.762+0000 7f66f3daf180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:20.787 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:20.778+0000 7fef54b23180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T00:52:20.811 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.802+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) -- 0x7f34c80050b0 con 0x7f34f00a2820 2024-04-26T00:52:21.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.994+0000 7f34dbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:21.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.994+0000 7f34dbfff640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.994+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34f0140900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:21.003 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:20.994+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:21.148 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.142+0000 7f5998b81180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:21.151 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.146+0000 7f66f3daf180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:21.178 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.170+0000 7fef54b23180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T00:52:21.204 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.198+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34f0140900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:21.204 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.198+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:21.279 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.270+0000 7f5998b81180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:21.286 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.278+0000 7f66f3daf180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:21.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:21.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:21.314 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.306+0000 7fef54b23180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T00:52:21.609 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.602+0000 7f34f5389640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34f0140900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:21.609 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.602+0000 7f34f5389640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T00:52:21.654 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.646+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 9 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f34e00c40f0 con 0x7f34f00a2820 2024-04-26T00:52:21.654 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.646+0000 7f34e5ffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:21.655 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.646+0000 7f34e5ffb640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:21.655 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.646+0000 7f34e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:21.657 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.650+0000 7f34e5ffb640 1 -- 172.21.15.6:0/3994012062 <== mon.2 v2:172.21.15.6:3301/0 10 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 module 'localpool' is already disabled v12) ==== 127+0+0 (secure 0 0 0) 0x7f34e00a6550 con 0x7f34f00a2820 2024-04-26T00:52:21.657 INFO:tasks.workunit.client.0.smithi006.stderr:module 'localpool' is already disabled 2024-04-26T00:52:21.660 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 10 mgrc shutdown 2024-04-26T00:52:21.661 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 msgr2=0x7f34f0140900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:21.661 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.661 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 msgr2=0x7f34f0139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:21.661 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c430 tx=0x7f34e000c8f0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 shutdown_connections 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f34d4099420 0x7f34f0140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34f014b780 0x7f34f0139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34f00a2820 0x7f34f0139410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 --2- 172.21.15.6:0/3994012062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00a0810 0x7f34f014d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 >> 172.21.15.6:0/3994012062 conn(0x7f34f006bda0 msgr2=0x7f34f01434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 shutdown_connections 2024-04-26T00:52:21.662 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.654+0000 7f34f75ed640 1 -- 172.21.15.6:0/3994012062 wait complete. 2024-04-26T00:52:21.680 INFO:tasks.workunit.client.0.smithi006.stderr:+ + grep ^by-host- 2024-04-26T00:52:21.680 INFO:tasks.workunit.client.0.smithi006.stderr:ceph osd pool ls 2024-04-26T00:52:21.709 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.702+0000 7f5998b81180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:21.718 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.710+0000 7f66f3daf180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:21.763 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.758+0000 7f5998b81180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:21.764 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.758+0000 7fef54b23180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:21.773 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.766+0000 7f66f3daf180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:21.793 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 Processor -- start 2024-04-26T00:52:21.793 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 -- start start 2024-04-26T00:52:21.794 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 0x7f17480a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.794 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f17480a5ae0 0x7f174814d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.794 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1748071000 con 0x7f17480b7e30 2024-04-26T00:52:21.795 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f17480b8210 con 0x7f17480a5ae0 2024-04-26T00:52:21.795 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f174d911640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f174806d680 con 0x7f1748070b30 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17467fc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 0x7f17480a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f1746ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17480b7e30 0x7f1748143790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45296/0 (socket says 172.21.15.6:45296) 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f1746ffd640 1 -- 172.21.15.6:0/764222733 learned_addr learned my addr 172.21.15.6:0/764222733 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17477fe640 1 --2- 172.21.15.6:0/764222733 >> v2:172.21.15.188:3300/0 conn(0x7f17480a5ae0 0x7f174814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f1745ffb640 1 -- 172.21.15.6:0/764222733 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043326582 0 0) 0x7f1748071000 con 0x7f17480b7e30 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17467fc640 1 -- 172.21.15.6:0/764222733 >> v2:172.21.15.188:3300/0 conn(0x7f17480a5ae0 msgr2=0x7f174814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17467fc640 1 --2- 172.21.15.6:0/764222733 >> v2:172.21.15.188:3300/0 conn(0x7f17480a5ae0 0x7f174814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17467fc640 1 -- 172.21.15.6:0/764222733 >> v1:172.21.15.6:6789/0 conn(0x7f17480b7e30 legacy=0x7f1748143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:21.796 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.786+0000 7f17467fc640 1 -- 172.21.15.6:0/764222733 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17480712c0 con 0x7f1748070b30 2024-04-26T00:52:21.797 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- 172.21.15.6:0/764222733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 0x7f17480a55a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17380097c0 tx=0x7f173801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14588f9eb318377c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f1745ffb640 1 -- 172.21.15.6:0/764222733 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b0070 con 0x7f1748070b30 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f1745ffb640 1 -- 172.21.15.6:0/764222733 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17380ab600 con 0x7f1748070b30 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f1745ffb640 1 -- 172.21.15.6:0/764222733 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380ab9d0 con 0x7f1748070b30 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/764222733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 msgr2=0x7f17480a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- 172.21.15.6:0/764222733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 0x7f17480a55a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17380097c0 tx=0x7f173801c360 comp rx=0 tx=0).stop 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/764222733 shutdown_connections 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- 172.21.15.6:0/764222733 >> v2:172.21.15.188:3300/0 conn(0x7f17480a5ae0 0x7f174814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- 172.21.15.6:0/764222733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1748070b30 0x7f17480a55a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/764222733 >> 172.21.15.6:0/764222733 conn(0x7f174806c6a0 msgr2=0x7f174806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/764222733 shutdown_connections 2024-04-26T00:52:21.798 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/764222733 wait complete. 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 Processor -- start 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- start start 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 0x7f174813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17480b7e30 0x7f17481390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17480a5280 con 0x7f1748070b30 2024-04-26T00:52:21.801 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17480a5100 con 0x7f17480b7e30 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1748150470 con 0x7f17480a5ae0 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f1746ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 0x7f174813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38386/0 (socket says 172.21.15.6:38386) 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 -- 172.21.15.6:0/1758272306 learned_addr learned my addr 172.21.15.6:0/1758272306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17477fe640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17480b7e30 0x7f17481390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17480b7e30 msgr2=0x7f17481390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17480b7e30 0x7f17481390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 msgr2=0x7f174813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 0x7f174813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1748140100 con 0x7f17480a5ae0 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f1746ffd640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 0x7f174813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:21.802 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f17467fc640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1738019f90 tx=0x7f1738019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b8020 con 0x7f17480a5ae0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17380b4410 con 0x7f17480a5ae0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174814d2e0 con 0x7f17480a5ae0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b0040 con 0x7f17480a5ae0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.790+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17481424d0 con 0x7f17480a5ae0 2024-04-26T00:52:21.803 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17480687d0 con 0x7f17480a5ae0 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f17380bb020 con 0x7f17480a5ae0 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 0x7f173409b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f1746ffd640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 msgr2=0x7f173409b950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5239+0+0 (secure 0 0 0) 0x7f173815c9a0 con 0x7f17480a5ae0 2024-04-26T00:52:21.804 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.794+0000 7f1746ffd640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 0x7f173409b950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:21.805 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.798+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f17380c2030 con 0x7f17480a5ae0 2024-04-26T00:52:21.813 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.806+0000 7f5998b81180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:21.820 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.814+0000 7fef54b23180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T00:52:21.823 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.818+0000 7f66f3daf180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:21.871 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.862+0000 7fef54b23180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T00:52:21.888 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.882+0000 7f5998b81180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:21.900 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.894+0000 7f66f3daf180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:21.939 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:21.930+0000 7f5998b81180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:21.949 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.942+0000 7fef54b23180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T00:52:21.951 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:21.942+0000 7f66f3daf180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:21.966 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.958+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f1748072ab0 con 0x7f17480a5ae0 2024-04-26T00:52:21.966 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.958+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+55 (secure 0 0 0) 0x7f1738016070 con 0x7f17480a5ae0 2024-04-26T00:52:22.001 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:21.994+0000 7fef54b23180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T00:52:22.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.998+0000 7f1746ffd640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 msgr2=0x7f173409b950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:22.004 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:21.998+0000 7f1746ffd640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 0x7f173409b950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:22.012 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.006+0000 7f5998b81180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:22.026 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.018+0000 7f66f3daf180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:22.061 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f174806e160 con 0x7f17480a5ae0 2024-04-26T00:52:22.061 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f172ffff640 1 -- 172.21.15.6:0/1758272306 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+55 (secure 0 0 0) 0x7f173812d380 con 0x7f17480a5ae0 2024-04-26T00:52:22.062 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.054+0000 7f5998b81180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 10 mgrc shutdown 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 msgr2=0x7f173409b950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 0x7f173409b950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 msgr2=0x7f1748141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1738019f90 tx=0x7f1738019100 comp rx=0 tx=0).stop 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 shutdown_connections 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1734099490 0x7f173409b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17480b7e30 0x7f17481390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17480a5ae0 0x7f1748141ca0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.064 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 --2- 172.21.15.6:0/1758272306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1748070b30 0x7f174813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.065 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 >> 172.21.15.6:0/1758272306 conn(0x7f174806c6a0 msgr2=0x7f17480b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:22.065 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 shutdown_connections 2024-04-26T00:52:22.065 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.054+0000 7f174d911640 1 -- 172.21.15.6:0/1758272306 wait complete. 2024-04-26T00:52:22.076 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.070+0000 7f66f3daf180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:22.078 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph osd pool rm by-host-smithi006 by-host-smithi006 --yes-i-really-really-mean-it 2024-04-26T00:52:22.078 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.070+0000 7fef54b23180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T00:52:22.131 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.122+0000 7fef54b23180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T00:52:22.201 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 Processor -- start 2024-04-26T00:52:22.201 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 -- start start 2024-04-26T00:52:22.202 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8f340a72e0 0x7f8f34070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8f34140380 0x7f8f3414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f340a52f0 con 0x7f8f3413ff30 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8f340a76c0 con 0x7f8f34140380 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f39df9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8f340a55b0 con 0x7f8f340a72e0 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8f34140380 0x7f8f3414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8f34140380 0x7f8f3414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44912/0 (socket says 172.21.15.6:44912) 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 -- 172.21.15.6:0/229230207 learned_addr learned my addr 172.21.15.6:0/229230207 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f337fe640 1 --2- 172.21.15.6:0/229230207 >> v2:172.21.15.188:3300/0 conn(0x7f8f340a72e0 0x7f8f34070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 -- 172.21.15.6:0/229230207 >> v2:172.21.15.188:3300/0 conn(0x7f8f340a72e0 msgr2=0x7f8f34070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 --2- 172.21.15.6:0/229230207 >> v2:172.21.15.188:3300/0 conn(0x7f8f340a72e0 0x7f8f34070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 -- 172.21.15.6:0/229230207 >> v1:172.21.15.188:6789/0 conn(0x7f8f3413ff30 legacy=0x7f8f340a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.203 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.194+0000 7f8f33fff640 1 -- 172.21.15.6:0/229230207 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f340a5e00 con 0x7f8f34140380 2024-04-26T00:52:22.204 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.198+0000 7f5998b81180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:22.205 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f33fff640 1 --2- 172.21.15.6:0/229230207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f3414d6a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f3406e240 tx=0x7f8f2c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e907a4a0c577790f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:22.205 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f327fc640 1 -- 172.21.15.6:0/229230207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0b4070 con 0x7f8f34140380 2024-04-26T00:52:22.205 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f327fc640 1 -- 172.21.15.6:0/229230207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0af400 con 0x7f8f34140380 2024-04-26T00:52:22.205 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f327fc640 1 -- 172.21.15.6:0/229230207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0af7d0 con 0x7f8f34140380 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- 172.21.15.6:0/229230207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 msgr2=0x7f8f3414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- 172.21.15.6:0/229230207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f3414d6a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f3406e240 tx=0x7f8f2c01f1c0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- 172.21.15.6:0/229230207 shutdown_connections 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- 172.21.15.6:0/229230207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f3414d6a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- 172.21.15.6:0/229230207 >> v2:172.21.15.188:3300/0 conn(0x7f8f340a72e0 0x7f8f34070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.206 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- 172.21.15.6:0/229230207 >> 172.21.15.6:0/229230207 conn(0x7f8f3406c8a0 msgr2=0x7f8f340a6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:22.207 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- 172.21.15.6:0/229230207 shutdown_connections 2024-04-26T00:52:22.207 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- 172.21.15.6:0/229230207 wait complete. 2024-04-26T00:52:22.207 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 Processor -- start 2024-04-26T00:52:22.207 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- start start 2024-04-26T00:52:22.209 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.209 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f3413ff30 0x7f8f3409be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.209 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f341dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3406e730 con 0x7f8f34140380 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f340712e0 con 0x7f8f3413ff30 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f39df9640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8f340a4e80 con 0x7f8f340a72e0 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f337fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f33fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f341dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f337fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38400/0 (socket says 172.21.15.6:38400) 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.198+0000 7f8f337fe640 1 -- 172.21.15.6:0/3567966432 learned_addr learned my addr 172.21.15.6:0/3567966432 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f32ffd640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f3413ff30 0x7f8f3409be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 msgr2=0x7f8f340a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f3413ff30 msgr2=0x7f8f3409be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f3413ff30 0x7f8f3409be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.210 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f340b7820 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f337fe640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f33fff640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f341dc2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f340a7a30 tx=0x7f8f2c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0b4040 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0090d0 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f341dbde0 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c009510 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3409b120 con 0x7f8f34140380 2024-04-26T00:52:22.211 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f340687d0 con 0x7f8f34140380 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f8f2c0c2060 con 0x7f8f34140380 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 0x7f8f2009b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.212 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f337fe640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 msgr2=0x7f8f2009b8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:22.213 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5239+0+0 (secure 0 0 0) 0x7f8f2c15fe30 con 0x7f8f34140380 2024-04-26T00:52:22.213 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.202+0000 7f8f337fe640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 0x7f8f2009b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:22.215 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.206+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8f2c018d20 con 0x7f8f34140380 2024-04-26T00:52:22.220 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.214+0000 7f66f3daf180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:22.256 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.250+0000 7f5998b81180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:22.273 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.266+0000 7f66f3daf180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:22.280 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.274+0000 7fef54b23180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T00:52:22.334 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.326+0000 7fef54b23180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T00:52:22.374 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.366+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi006", "pool2": "by-host-smithi006", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f3409add0 con 0x7f8f34140380 2024-04-26T00:52:22.412 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.406+0000 7f8f337fe640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 msgr2=0x7f8f2009b8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:22.412 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.406+0000 7f8f337fe640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 0x7f8f2009b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:22.496 INFO:tasks.ceph.mgr.z.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:22.496 INFO:tasks.ceph.mgr.z.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:22.496 INFO:tasks.ceph.mgr.z.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:22.503 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.498+0000 7f5998b81180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:22.513 INFO:tasks.ceph.mgr.y.smithi188.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:22.513 INFO:tasks.ceph.mgr.y.smithi188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:22.514 INFO:tasks.ceph.mgr.y.smithi188.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:22.521 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.514+0000 7f66f3daf180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:22.559 INFO:tasks.ceph.mgr.x.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T00:52:22.559 INFO:tasks.ceph.mgr.x.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T00:52:22.559 INFO:tasks.ceph.mgr.x.smithi006.stderr: from numpy import show_config as show_numpy_config 2024-04-26T00:52:22.566 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.558+0000 7fef54b23180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T00:52:22.638 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.630+0000 7f5998b81180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:22.642 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.634+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi006", "pool2": "by-host-smithi006", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi006' removed v29) ==== 187+0+0 (secure 0 0 0) 0x7f8f2c130770 con 0x7f8f34140380 2024-04-26T00:52:22.660 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.654+0000 7f66f3daf180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:22.740 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.734+0000 7fef54b23180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:22.758 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.750+0000 7f5998b81180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:22.772 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.766+0000 7f66f3daf180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:22.777 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.766+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi006", "pool2": "by-host-smithi006", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f34142880 con 0x7f8f34140380 2024-04-26T00:52:22.777 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f1bfff640 1 -- 172.21.15.6:0/3567966432 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi006", "pool2": "by-host-smithi006", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi006' does not exist v29) ==== 194+0+0 (secure 0 0 0) 0x7f8f2c130070 con 0x7f8f34140380 2024-04-26T00:52:22.777 INFO:tasks.workunit.client.0.smithi006.stderr:pool 'by-host-smithi006' does not exist 2024-04-26T00:52:22.779 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 10 mgrc shutdown 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 msgr2=0x7f8f2009b8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 0x7f8f2009b8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 msgr2=0x7f8f341dc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f341dc2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f340a7a30 tx=0x7f8f2c01bf60 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 shutdown_connections 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f8f200993e0 0x7f8f2009b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f34140380 0x7f8f341dc2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f3413ff30 0x7f8f3409be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 --2- 172.21.15.6:0/3567966432 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f340a72e0 0x7f8f340a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 >> 172.21.15.6:0/3567966432 conn(0x7f8f3406c8a0 msgr2=0x7f8f340725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 shutdown_connections 2024-04-26T00:52:22.780 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.770+0000 7f8f39df9640 1 -- 172.21.15.6:0/3567966432 wait complete. 2024-04-26T00:52:22.793 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph config rm mgr mgr/localpool/subtree 2024-04-26T00:52:22.824 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.818+0000 7f5998b81180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:22.835 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.826+0000 7f66f3daf180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:22.858 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.850+0000 7fef54b23180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T00:52:22.900 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.890+0000 7f3946ec7640 1 Processor -- start 2024-04-26T00:52:22.900 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.890+0000 7f3946ec7640 1 -- start start 2024-04-26T00:52:22.901 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3946ec7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39400735a0 0x7f394014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.901 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3946ec7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.901 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3946ec7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400a58f0 con 0x7f3940074420 2024-04-26T00:52:22.901 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3946ec7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3940074800 con 0x7f39400735a0 2024-04-26T00:52:22.901 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3946ec7640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f39400a0a10 con 0x7f3940147280 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39400735a0 0x7f394014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3945464640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39400735a0 0x7f394014ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 -- 172.21.15.6:0/518608091 learned_addr learned my addr 172.21.15.6:0/518608091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3944c63640 1 --1- 172.21.15.6:0/518608091 >> v1:172.21.15.6:6789/0 conn(0x7f3940074420 0x7f3940145b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45302/0 (socket says 172.21.15.6:45302) 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 -- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 msgr2=0x7f394014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394014dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 -- 172.21.15.6:0/518608091 >> v1:172.21.15.6:6789/0 conn(0x7f3940074420 legacy=0x7f3940145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 -- 172.21.15.6:0/518608091 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400a0c70 con 0x7f39400735a0 2024-04-26T00:52:22.902 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f3945464640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:22.904 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393ffff640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f394014ba90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f392c009870 tx=0x7f392c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a91faf501c0727 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:22.904 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393f7fe640 1 -- 172.21.15.6:0/518608091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0b0070 con 0x7f39400735a0 2024-04-26T00:52:22.904 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393f7fe640 1 -- 172.21.15.6:0/518608091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c0ab600 con 0x7f39400735a0 2024-04-26T00:52:22.904 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.894+0000 7f393f7fe640 1 -- 172.21.15.6:0/518608091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0ab9d0 con 0x7f39400735a0 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 msgr2=0x7f394014ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f394014ba90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f392c009870 tx=0x7f392c01c420 comp rx=0 tx=0).stop 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/518608091 shutdown_connections 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- 172.21.15.6:0/518608091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f394014ba90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/518608091 >> 172.21.15.6:0/518608091 conn(0x7f39400b6eb0 msgr2=0x7f39400b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:22.905 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/518608091 shutdown_connections 2024-04-26T00:52:22.906 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/518608091 wait complete. 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 Processor -- start 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- start start 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3940074420 0x7f39400b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394013ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f394006bfe0 con 0x7f39400735a0 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39400a0f50 con 0x7f3940074420 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f39400a0120 con 0x7f3940147280 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3945464640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394013ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44952/0 (socket says 172.21.15.6:44952) 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 -- 172.21.15.6:0/245954742 learned_addr learned my addr 172.21.15.6:0/245954742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:22.908 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f393ffff640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3940074420 0x7f39400b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 msgr2=0x7f394013ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394013ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3940074420 msgr2=0x7f39400b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3940074420 0x7f39400b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39401428f0 con 0x7f39400735a0 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3945464640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394013ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3944c63640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f393400c450 tx=0x7f393400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:22.909 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340074e0 con 0x7f39400735a0 2024-04-26T00:52:22.910 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39340076a0 con 0x7f39400735a0 2024-04-26T00:52:22.910 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934004a30 con 0x7f39400735a0 2024-04-26T00:52:22.910 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3940072cd0 con 0x7f39400735a0 2024-04-26T00:52:22.910 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.898+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39400b6640 con 0x7f39400735a0 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39400687d0 con 0x7f39400735a0 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f393401a020 con 0x7f39400735a0 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:22.911 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 0x7f392409b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:22.912 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393ffff640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 msgr2=0x7f392409b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:22.912 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7f39340c2610 con 0x7f39400735a0 2024-04-26T00:52:22.912 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.902+0000 7f393ffff640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 0x7f392409b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:22.914 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:22.906+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3934021070 con 0x7f39400735a0 2024-04-26T00:52:22.926 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:22.918+0000 7fef54b23180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T00:52:22.967 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:22.958+0000 7f5998b81180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:22.973 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:22.966+0000 7f66f3daf180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:23.066 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:23.058+0000 7fef54b23180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T00:52:23.073 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.066+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) -- 0x7f39400a33d0 con 0x7f39400735a0 2024-04-26T00:52:23.079 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.070+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f3940072cd0 con 0x7f39400735a0 2024-04-26T00:52:23.112 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.106+0000 7f393ffff640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 msgr2=0x7f392409b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:23.112 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.106+0000 7f393ffff640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 0x7f392409b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:23.173 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) -- 0x7f39400008e0 con 0x7f39400735a0 2024-04-26T00:52:23.173 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f393d7fa640 1 -- 172.21.15.6:0/245954742 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f3934093260 con 0x7f39400735a0 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 10 mgrc shutdown 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 msgr2=0x7f392409b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 0x7f392409b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 msgr2=0x7f3940072790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f393400c450 tx=0x7f393400c850 comp rx=0 tx=0).stop 2024-04-26T00:52:23.176 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 shutdown_connections 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f3924099460 0x7f392409b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3940147280 0x7f394013ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3940074420 0x7f39400b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 --2- 172.21.15.6:0/245954742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39400735a0 0x7f3940072790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.166+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 >> 172.21.15.6:0/245954742 conn(0x7f39400b6eb0 msgr2=0x7f394006cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.170+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 shutdown_connections 2024-04-26T00:52:23.177 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.170+0000 7f3946ec7640 1 -- 172.21.15.6:0/245954742 wait complete. 2024-04-26T00:52:23.190 INFO:tasks.workunit.client.0.smithi006.stderr:+ ceph config rm mgr mgr/localpool/failure_domain 2024-04-26T00:52:23.307 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 Processor -- start 2024-04-26T00:52:23.307 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 -- start start 2024-04-26T00:52:23.308 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.308 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7de814b780 0x7f7de814db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.308 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de80a6770 con 0x7f7de80a5d80 2024-04-26T00:52:23.308 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7de80a69e0 con 0x7f7de814b780 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7dedc3d640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7de80725f0 con 0x7f7de80a6ee0 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7de6ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7de6ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38414/0 (socket says 172.21.15.6:38414) 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7de77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7de80a5d80 0x7f7de80a9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45308/0 (socket says 172.21.15.6:45308) 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.298+0000 7f7de6ffd640 1 -- 172.21.15.6:0/867188114 learned_addr learned my addr 172.21.15.6:0/867188114 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de7fff640 1 --2- 172.21.15.6:0/867188114 >> v2:172.21.15.6:3300/0 conn(0x7f7de814b780 0x7f7de814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de6ffd640 1 -- 172.21.15.6:0/867188114 >> v2:172.21.15.6:3300/0 conn(0x7f7de814b780 msgr2=0x7f7de814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de6ffd640 1 --2- 172.21.15.6:0/867188114 >> v2:172.21.15.6:3300/0 conn(0x7f7de814b780 0x7f7de814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de67fc640 1 -- 172.21.15.6:0/867188114 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661665345 0 0) 0x7f7de80a6770 con 0x7f7de80a5d80 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de6ffd640 1 -- 172.21.15.6:0/867188114 >> v1:172.21.15.6:6789/0 conn(0x7f7de80a5d80 legacy=0x7f7de80a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.309 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de6ffd640 1 -- 172.21.15.6:0/867188114 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de80a91d0 con 0x7f7de80a6ee0 2024-04-26T00:52:23.310 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de6ffd640 1 --2- 172.21.15.6:0/867188114 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd610d6527ec4369 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:23.310 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de67fc640 1 -- 172.21.15.6:0/867188114 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00b1070 con 0x7f7de80a6ee0 2024-04-26T00:52:23.310 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de67fc640 1 -- 172.21.15.6:0/867188114 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00ac630 con 0x7f7de80a6ee0 2024-04-26T00:52:23.311 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7de67fc640 1 -- 172.21.15.6:0/867188114 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00a8050 con 0x7f7de80a6ee0 2024-04-26T00:52:23.311 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 -- 172.21.15.6:0/867188114 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 msgr2=0x7f7de80a7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.311 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/867188114 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd001c540 comp rx=0 tx=0).stop 2024-04-26T00:52:23.311 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 -- 172.21.15.6:0/867188114 shutdown_connections 2024-04-26T00:52:23.312 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/867188114 >> v2:172.21.15.6:3300/0 conn(0x7f7de814b780 0x7f7de814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.312 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/867188114 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a6ee0 0x7f7de80a7340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.312 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 -- 172.21.15.6:0/867188114 >> 172.21.15.6:0/867188114 conn(0x7f7de80a7a60 msgr2=0x7f7de80a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:23.312 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 -- 172.21.15.6:0/867188114 shutdown_connections 2024-04-26T00:52:23.312 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.302+0000 7f7dedc3d640 1 -- 172.21.15.6:0/867188114 wait complete. 2024-04-26T00:52:23.314 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 Processor -- start 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- start start 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7de80a6ee0 0x7f7de813c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7de814b780 0x7f7de8138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7de80aa260 con 0x7f7de814b780 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7de80a5860 con 0x7f7de80a6ee0 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f7de80a6160 con 0x7f7de80a5d80 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38416/0 (socket says 172.21.15.6:38416) 2024-04-26T00:52:23.315 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 -- 172.21.15.6:0/1322518885 learned_addr learned my addr 172.21.15.6:0/1322518885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de7fff640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7de814b780 0x7f7de8138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de6ffd640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7de80a6ee0 0x7f7de813c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7de80a6ee0 msgr2=0x7f7de813c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7de80a6ee0 0x7f7de813c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7de814b780 msgr2=0x7f7de8138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7de814b780 0x7f7de8138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de813cc40 con 0x7f7de80a5d80 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7de77fe640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7de00011f0 tx=0x7f7de000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0018070 con 0x7f7de80a5d80 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de00074e0 con 0x7f7de80a5d80 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de8146430 con 0x7f7de80a5d80 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0004a10 con 0x7f7de80a5d80 2024-04-26T00:52:23.316 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de81391e0 con 0x7f7de80a5d80 2024-04-26T00:52:23.317 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de8069700 con 0x7f7de80a5d80 2024-04-26T00:52:23.317 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f7de001b070 con 0x7f7de80a5d80 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.306+0000 7f7ddffff640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7ddffff640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7ddffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7ddffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7ddffff640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 0x7f7dc809b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7de6ffd640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 msgr2=0x7f7dc809b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7f7de00c1cf0 con 0x7f7de80a5d80 2024-04-26T00:52:23.318 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.310+0000 7f7de6ffd640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 0x7f7dc809b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:23.324 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.314+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7de0092940 con 0x7f7de80a5d80 2024-04-26T00:52:23.452 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:23.446+0000 7f5998b81180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:23.472 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:23.466+0000 7f66f3daf180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:23.484 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.474+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) -- 0x7f7de814d920 con 0x7f7de80a5d80 2024-04-26T00:52:23.490 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.482+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) ==== 111+0+0 (secure 0 0 0) 0x7f7de0092240 con 0x7f7de80a5d80 2024-04-26T00:52:23.520 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.514+0000 7f7de6ffd640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 msgr2=0x7f7dc809b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:23.520 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.514+0000 7f7de6ffd640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 0x7f7dc809b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T00:52:23.526 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:23.518+0000 7f5998b81180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:23.549 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:23.542+0000 7f66f3daf180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:23.580 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:23.570+0000 7fef54b23180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T00:52:23.586 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.578+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) -- 0x7f7de80008e0 con 0x7f7de80a5d80 2024-04-26T00:52:23.588 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.578+0000 7f7ddffff640 1 -- 172.21.15.6:0/1322518885 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) ==== 111+0+0 (secure 0 0 0) 0x7f7de00965f0 con 0x7f7de80a5d80 2024-04-26T00:52:23.591 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 10 mgrc shutdown 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 msgr2=0x7f7dc809b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 0x7f7dc809b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 msgr2=0x7f7de80a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7de00011f0 tx=0x7f7de000c9b0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 shutdown_connections 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f7dc8099460 0x7f7dc809b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7de814b780 0x7f7de8138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7de80a6ee0 0x7f7de813c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.592 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 --2- 172.21.15.6:0/1322518885 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7de80a5d80 0x7f7de80a4b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:23.593 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 >> 172.21.15.6:0/1322518885 conn(0x7f7de80a7a60 msgr2=0x7f7de813fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:23.593 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 shutdown_connections 2024-04-26T00:52:23.593 INFO:tasks.workunit.client.0.smithi006.stderr:2024-04-26T00:52:23.582+0000 7f7dedc3d640 1 -- 172.21.15.6:0/1322518885 wait complete. 2024-04-26T00:52:23.605 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo OK 2024-04-26T00:52:23.606 INFO:tasks.workunit.client.0.smithi006.stdout:OK 2024-04-26T00:52:23.606 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T00:52:23.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T00:52:23.618 INFO:tasks.workunit:Stopping ['mgr/test_localpool.sh'] on client.0... 2024-04-26T00:52:23.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T00:52:23.659 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:23.650+0000 7fef54b23180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T00:52:23.674 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:23.666+0000 7f5998b81180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:23.699 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:23.694+0000 7f66f3daf180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:23.749 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:23.742+0000 7f5998b81180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:23.774 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:23.766+0000 7f66f3daf180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:23.812 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:23.802+0000 7fef54b23180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T00:52:23.891 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:23.882+0000 7fef54b23180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T00:52:23.937 DEBUG:teuthology.parallel:result is None 2024-04-26T00:52:23.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:52:23.950 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:52:23.950 DEBUG:teuthology.orchestra.run.smithi006:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T00:52:24.002 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:52:24.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T00:52:24.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T00:52:24.037 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:24.030+0000 7f5998b81180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:24.065 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:24.058+0000 7f66f3daf180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:24.091 INFO:tasks.ceph.mgr.z.smithi188.stderr:2024-04-26T00:52:24.086+0000 7f5998b81180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:24.120 INFO:tasks.ceph.mgr.y.smithi188.stderr:2024-04-26T00:52:24.114+0000 7f66f3daf180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 Processor -- start 2024-04-26T00:52:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 -- start start 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c20071570 0x7f1c2014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c201450e0 con 0x7f1c200b4530 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c20145360 con 0x7f1c200b4150 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c27998640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1c200b5a00 con 0x7f1c20071570 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c24f33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1c200b4530 0x7f1c20070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45322/0 (socket says 172.21.15.6:45322) 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c24f33640 1 -- 172.21.15.6:0/3953609040 learned_addr learned my addr 172.21.15.6:0/3953609040 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c25f35640 1 --2- 172.21.15.6:0/3953609040 >> v2:172.21.15.188:3300/0 conn(0x7f1c20071570 0x7f1c2014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c17fff640 1 -- 172.21.15.6:0/3953609040 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844740595 0 0) 0x7f1c10001120 con 0x7f1c200b4530 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c17fff640 1 -- 172.21.15.6:0/3953609040 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c0c003530 con 0x7f1c200b4530 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c25f35640 1 -- 172.21.15.6:0/3953609040 >> v1:172.21.15.188:6789/0 conn(0x7f1c200b4150 legacy=0x7f1c20141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c25f35640 1 -- 172.21.15.6:0/3953609040 >> v1:172.21.15.6:6789/0 conn(0x7f1c200b4530 legacy=0x7f1c20070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c25f35640 1 -- 172.21.15.6:0/3953609040 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c200b70e0 con 0x7f1c20071570 2024-04-26T00:52:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.162+0000 7f1c25f35640 1 --2- 172.21.15.6:0/3953609040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c20071570 0x7f1c2014d3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009d90 tx=0x7f1c1801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6d9e8ad9d4cb45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c17fff640 1 -- 172.21.15.6:0/3953609040 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c180b2070 con 0x7f1c20071570 2024-04-26T00:52:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c17fff640 1 -- 172.21.15.6:0/3953609040 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c180a5890 con 0x7f1c20071570 2024-04-26T00:52:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c17fff640 1 -- 172.21.15.6:0/3953609040 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c180a5c40 con 0x7f1c20071570 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/3953609040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c20071570 msgr2=0x7f1c2014d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 --2- 172.21.15.6:0/3953609040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c20071570 0x7f1c2014d3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009d90 tx=0x7f1c1801c8c0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/3953609040 shutdown_connections 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 --2- 172.21.15.6:0/3953609040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c20071570 0x7f1c2014d3e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/3953609040 >> 172.21.15.6:0/3953609040 conn(0x7f1c2006cb40 msgr2=0x7f1c2006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/3953609040 shutdown_connections 2024-04-26T00:52:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/3953609040 wait complete. 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 Processor -- start 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- start start 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 0x7f1c2014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c200b4530 0x7f1c20147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2006be40 con 0x7f1c20071570 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2006bcc0 con 0x7f1c200b4530 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2006bfc0 con 0x7f1c200b4150 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c25734640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 0x7f1c2014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c25734640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44970/0 (socket says 172.21.15.6:44970) 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c25734640 1 -- 172.21.15.6:0/2653387948 learned_addr learned my addr 172.21.15.6:0/2653387948 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c25f35640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c200b4530 0x7f1c20147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 -- 172.21.15.6:0/2653387948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c200b4530 msgr2=0x7f1c20147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c200b4530 0x7f1c20147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 -- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 msgr2=0x7f1c201409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 -- 172.21.15.6:0/2653387948 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2014bc50 con 0x7f1c200b4150 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c25734640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c24f33640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 0x7f1c2014b3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c3c0 tx=0x7f1c1000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10017070 con 0x7f1c200b4150 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c10005cf0 con 0x7f1c200b4150 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2014a6e0 con 0x7f1c200b4150 2024-04-26T00:52:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c100072f0 con 0x7f1c200b4150 2024-04-26T00:52:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2014b900 con 0x7f1c200b4150 2024-04-26T00:52:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.166+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2006db70 con 0x7f1c200b4150 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 12) ==== 130939+0+0 (secure 0 0 0) 0x7f1c1001a070 con 0x7f1c200b4150 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 4 mgrc handle_mgr_map Got map version 12 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 0x7f1c0409b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c25734640 1 -- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 msgr2=0x7f1c0409b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6808/346340426 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7f1c100c1b90 con 0x7f1c200b4150 2024-04-26T00:52:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.170+0000 7f1c25734640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 0x7f1c0409b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T00:52:24.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.174+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1c201450e0 con 0x7f1c200b4150 2024-04-26T00:52:24.192 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.182+0000 7fef54b23180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T00:52:24.249 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.242+0000 7fef54b23180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 13) ==== 130548+0+0 (secure 0 0 0) 0x7f1c100c03e0 con 0x7f1c200b4150 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 4 mgrc handle_mgr_map Got map version 13 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 4 mgrc reconnect Terminating session with v2:172.21.15.6:6808/346340426 2024-04-26T00:52:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 msgr2=0x7f1c0409b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:52:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 0x7f1c0409b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.282+0000 7f1c15ffb640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:52:24.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.350+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1c200b5c60 con 0x7f1c200b4150 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feee0632640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feee0632640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feee0632640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feee0632640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feee0632640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feedde2d640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feedde2d640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feedde2d640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feedde2d640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.362 INFO:tasks.ceph.mgr.x.smithi006.stderr:2024-04-26T00:52:24.354+0000 7feedde2d640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T00:52:24.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.358+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1c10021250 con 0x7f1c200b4150 2024-04-26T00:52:24.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.358+0000 7f1c15ffb640 1 -- 172.21.15.6:0/2653387948 <== mon.2 v2:172.21.15.6:3301/0 9 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f1c100927e0 con 0x7f1c200b4150 2024-04-26T00:52:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 10 mgrc shutdown 2024-04-26T00:52:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 msgr2=0x7f1c2014b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 0x7f1c2014b3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c3c0 tx=0x7f1c1000c880 comp rx=0 tx=0).stop 2024-04-26T00:52:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 shutdown_connections 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:6808/346340426,v1:172.21.15.6:6809/346340426] conn(0x7f1c04099460 0x7f1c0409b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c200b4530 0x7f1c20147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c200b4150 0x7f1c2014b3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 --2- 172.21.15.6:0/2653387948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c20071570 0x7f1c201409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 >> 172.21.15.6:0/2653387948 conn(0x7f1c2006cb40 msgr2=0x7f1c20074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 shutdown_connections 2024-04-26T00:52:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.362+0000 7f1c27998640 1 -- 172.21.15.6:0/2653387948 wait complete. 2024-04-26T00:52:24.388 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T00:52:24.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:52:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.486+0000 7fc73ef90640 1 Processor -- start 2024-04-26T00:52:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.486+0000 7fc73ef90640 1 -- start start 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc738071870 0x7fc7381422e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738142ee0 con 0x7fc7380730e0 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc7380ac680 con 0x7fc738071870 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fc738143180 con 0x7fc738071ff0 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38534/0 (socket says 172.21.15.6:38534) 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 -- 172.21.15.6:0/1352660245 learned_addr learned my addr 172.21.15.6:0/1352660245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73d52d640 1 --1- 172.21.15.6:0/1352660245 >> v1:172.21.15.6:6789/0 conn(0x7fc7380730e0 0x7fc7380a91f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45338/0 (socket says 172.21.15.6:45338) 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 -- 172.21.15.6:0/1352660245 >> v2:172.21.15.188:3300/0 conn(0x7fc738071870 msgr2=0x7fc7381422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc737fff640 1 --2- 172.21.15.6:0/1352660245 >> v2:172.21.15.188:3300/0 conn(0x7fc738071870 0x7fc7381422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc7377fe640 1 -- 172.21.15.6:0/1352660245 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789978315 0 0) 0x7fc738142ee0 con 0x7fc7380730e0 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 --2- 172.21.15.6:0/1352660245 >> v2:172.21.15.188:3300/0 conn(0x7fc738071870 0x7fc7381422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 -- 172.21.15.6:0/1352660245 >> v1:172.21.15.6:6789/0 conn(0x7fc7380730e0 legacy=0x7fc7380a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 -- 172.21.15.6:0/1352660245 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7380acb10 con 0x7fc738071ff0 2024-04-26T00:52:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73cd2c640 1 --2- 172.21.15.6:0/1352660245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc728009e50 tx=0x7fc72801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f8d10184e1899d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc7377fe640 1 -- 172.21.15.6:0/1352660245 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a5750 con 0x7fc738071ff0 2024-04-26T00:52:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc7377fe640 1 -- 172.21.15.6:0/1352660245 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc7280a58f0 con 0x7fc738071ff0 2024-04-26T00:52:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc7377fe640 1 -- 172.21.15.6:0/1352660245 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a5ce0 con 0x7fc738071ff0 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- 172.21.15.6:0/1352660245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 msgr2=0x7fc7380b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 --2- 172.21.15.6:0/1352660245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc728009e50 tx=0x7fc72801c940 comp rx=0 tx=0).stop 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- 172.21.15.6:0/1352660245 shutdown_connections 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 --2- 172.21.15.6:0/1352660245 >> v2:172.21.15.188:3300/0 conn(0x7fc738071870 0x7fc7381422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 --2- 172.21.15.6:0/1352660245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc738071ff0 0x7fc7380b8bb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- 172.21.15.6:0/1352660245 >> 172.21.15.6:0/1352660245 conn(0x7fc73806cc00 msgr2=0x7fc738070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- 172.21.15.6:0/1352660245 shutdown_connections 2024-04-26T00:52:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.490+0000 7fc73ef90640 1 -- 172.21.15.6:0/1352660245 wait complete. 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 Processor -- start 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- start start 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc738071870 0x7fc73814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 0x7fc7380a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc738150750 con 0x7fc738149280 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7381505d0 con 0x7fc738071870 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7fc7381508d0 con 0x7fc7380730e0 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73d52d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 0x7fc7380a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73d52d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45072/0 (socket says 172.21.15.6:45072) 2024-04-26T00:52:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73d52d640 1 -- 172.21.15.6:0/2001409752 learned_addr learned my addr 172.21.15.6:0/2001409752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73cd2c640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc738071870 0x7fc73814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 -- 172.21.15.6:0/2001409752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc738071870 msgr2=0x7fc73814a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc738071870 0x7fc73814a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 -- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 msgr2=0x7fc738140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 -- 172.21.15.6:0/2001409752 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7381451e0 con 0x7fc7380730e0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73d52d640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc737fff640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 0x7fc7380a71f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c7c0 tx=0x7fc72c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c015070 con 0x7fc7380730e0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc72c004220 con 0x7fc7380730e0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c003620 con 0x7fc7380730e0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc738140850 con 0x7fc7380730e0 2024-04-26T00:52:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc738149a00 con 0x7fc7380730e0 2024-04-26T00:52:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.494+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73806db70 con 0x7fc7380730e0 2024-04-26T00:52:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 13) ==== 130548+0+0 (secure 0 0 0) 0x7fc72c0037c0 con 0x7fc7380730e0 2024-04-26T00:52:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-26T00:52:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 4 mgrc handle_mgr_map Got map version 13 2024-04-26T00:52:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:52:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:52:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fc72c0c2280 con 0x7fc7380730e0 2024-04-26T00:52:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.498+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc72c0932e0 con 0x7fc7380730e0 2024-04-26T00:52:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.698+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7381478a0 con 0x7fc7380730e0 2024-04-26T00:52:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.698+0000 7fc7357fa640 1 -- 172.21.15.6:0/2001409752 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7fc72c092be0 con 0x7fc7380730e0 2024-04-26T00:52:24.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:52:24.707 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:52:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:52:24.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 10 mgrc shutdown 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 msgr2=0x7fc7380a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 0x7fc7380a71f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c7c0 tx=0x7fc72c00cc80 comp rx=0 tx=0).stop 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 shutdown_connections 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc738149280 0x7fc738140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7380730e0 0x7fc7380a71f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 --2- 172.21.15.6:0/2001409752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc738071870 0x7fc73814a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 >> 172.21.15.6:0/2001409752 conn(0x7fc73806cc00 msgr2=0x7fc73813e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 shutdown_connections 2024-04-26T00:52:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.702+0000 7fc73ef90640 1 -- 172.21.15.6:0/2001409752 wait complete. 2024-04-26T00:52:24.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T00:52:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.830+0000 7f281c333640 1 Processor -- start 2024-04-26T00:52:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.830+0000 7f281c333640 1 -- start start 2024-04-26T00:52:24.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281c333640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281c333640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 0x7f281414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281c333640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2814148870 con 0x7f28140abd20 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281c333640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f281406c7f0 con 0x7f281414d7d0 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281c333640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f2814148b30 con 0x7f281406c410 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f28198ce640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28140abd20 0x7f28141446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45342/0 (socket says 172.21.15.6:45342) 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38556/0 (socket says 172.21.15.6:38556) 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f28198ce640 1 -- 172.21.15.6:0/3342623009 learned_addr learned my addr 172.21.15.6:0/3342623009 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a8d0640 1 --2- 172.21.15.6:0/3342623009 >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 0x7f281414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 -- 172.21.15.6:0/3342623009 >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 msgr2=0x7f281414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 --2- 172.21.15.6:0/3342623009 >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 0x7f281414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 -- 172.21.15.6:0/3342623009 >> v1:172.21.15.6:6789/0 conn(0x7f28140abd20 legacy=0x7f28141446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 -- 172.21.15.6:0/3342623009 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28140aaaa0 con 0x7f281406c410 2024-04-26T00:52:24.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a8d0640 1 --2- 172.21.15.6:0/3342623009 >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 0x7f281414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:24.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f281a0cf640 1 --2- 172.21.15.6:0/3342623009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280c009d90 tx=0x7f280c01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fbe8e42b02121c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f28190cd640 1 -- 172.21.15.6:0/3342623009 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0a8650 con 0x7f281406c410 2024-04-26T00:52:24.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f28190cd640 1 -- 172.21.15.6:0/3342623009 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f280c0a87f0 con 0x7f281406c410 2024-04-26T00:52:24.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.834+0000 7f28190cd640 1 -- 172.21.15.6:0/3342623009 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0a8be0 con 0x7f281406c410 2024-04-26T00:52:24.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/3342623009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 msgr2=0x7f281406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- 172.21.15.6:0/3342623009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280c009d90 tx=0x7f280c01c7e0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/3342623009 shutdown_connections 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- 172.21.15.6:0/3342623009 >> v2:172.21.15.188:3300/0 conn(0x7f281414d7d0 0x7f281414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- 172.21.15.6:0/3342623009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f281406c410 0x7f281406f0e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/3342623009 >> 172.21.15.6:0/3342623009 conn(0x7f28140bacf0 msgr2=0x7f28140bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/3342623009 shutdown_connections 2024-04-26T00:52:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/3342623009 wait complete. 2024-04-26T00:52:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 Processor -- start 2024-04-26T00:52:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- start start 2024-04-26T00:52:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28140abd20 0x7f2814143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 0x7f28141437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28141485d0 con 0x7f281406c410 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2814148450 con 0x7f281414d7d0 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f2814152920 con 0x7f28140abd20 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45076/0 (socket says 172.21.15.6:45076) 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 -- 172.21.15.6:0/4053611783 learned_addr learned my addr 172.21.15.6:0/4053611783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f28198ce640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28140abd20 0x7f2814143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a8d0640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 0x7f28141437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 -- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28140abd20 msgr2=0x7f2814143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28140abd20 0x7f2814143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 -- 172.21.15.6:0/4053611783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 msgr2=0x7f28141437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 0x7f28141437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 -- 172.21.15.6:0/4053611783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2814144ad0 con 0x7f281406c410 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a8d0640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 0x7f28141437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281a0cf640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f280c01ae90 tx=0x7f280c019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0bf070 con 0x7f281406c410 2024-04-26T00:52:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f280c0b0610 con 0x7f281406c410 2024-04-26T00:52:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2814144d90 con 0x7f281406c410 2024-04-26T00:52:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0b0a00 con 0x7f281406c410 2024-04-26T00:52:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2814142ed0 con 0x7f281406c410 2024-04-26T00:52:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.838+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2814141e30 con 0x7f281406c410 2024-04-26T00:52:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 130548+0+0 (secure 0 0 0) 0x7f280c0c2070 con 0x7f281406c410 2024-04-26T00:52:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-26T00:52:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 4 mgrc handle_mgr_map Got map version 13 2024-04-26T00:52:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:52:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:52:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.842+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f280c15cd90 con 0x7f281406c410 2024-04-26T00:52:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:24.846+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f280c0c9020 con 0x7f281406c410 2024-04-26T00:52:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.034+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f281406db70 con 0x7f281406c410 2024-04-26T00:52:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.034+0000 7f2812ffd640 1 -- 172.21.15.6:0/4053611783 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+4348 (secure 0 0 0) 0x7f280c0ac030 con 0x7f281406c410 2024-04-26T00:52:25.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:52:25.044 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6811/1376057237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1376057237},{"type":"v1","addr":"172.21.15.6:6811","nonce":1376057237}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6813/1436468197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1436468197},{"type":"v1","addr":"172.21.15.6:6813","nonce":1436468197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T00:50:39.211984+0000","modified":"2024-04-26T00:50:42.225246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6825/3094432965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3094432965},{"type":"v1","addr":"172.21.15.188:6825","nonce":3094432965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-26T00:52:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 10 mgrc shutdown 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 msgr2=0x7f281414f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f280c01ae90 tx=0x7f280c019580 comp rx=0 tx=0).stop 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 shutdown_connections 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f281414d7d0 0x7f28141437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28140abd20 0x7f2814143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 --2- 172.21.15.6:0/4053611783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f281406c410 0x7f281414f9f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 >> 172.21.15.6:0/4053611783 conn(0x7f28140bacf0 msgr2=0x7f281406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 shutdown_connections 2024-04-26T00:52:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.038+0000 7f281c333640 1 -- 172.21.15.6:0/4053611783 wait complete. 2024-04-26T00:52:25.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:52:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.162+0000 7f0b24994640 1 Processor -- start 2024-04-26T00:52:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.162+0000 7f0b24994640 1 -- start start 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b24994640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0b200abd20 0x7f0b201456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b24994640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b24994640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b20148870 con 0x7f0b2006c410 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b24994640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2006c7f0 con 0x7f0b200abd20 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b24994640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0b20148b30 con 0x7f0b2014d7d0 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38574/0 (socket says 172.21.15.6:38574) 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/1712164195 learned_addr learned my addr 172.21.15.6:0/1712164195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1dd9b640 1 --2- 172.21.15.6:0/1712164195 >> v2:172.21.15.188:3300/0 conn(0x7f0b200abd20 0x7f0b201456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/1712164195 >> v2:172.21.15.188:3300/0 conn(0x7f0b200abd20 msgr2=0x7f0b201456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 --2- 172.21.15.6:0/1712164195 >> v2:172.21.15.188:3300/0 conn(0x7f0b200abd20 0x7f0b201456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/1712164195 >> v1:172.21.15.188:6789/0 conn(0x7f0b2006c410 legacy=0x7f0b2006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/1712164195 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b200aaaa0 con 0x7f0b2014d7d0 2024-04-26T00:52:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1ed9d640 1 --2- 172.21.15.6:0/1712164195 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009870 tx=0x7f0b1801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41fcb5cde416002f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1d59a640 1 -- 172.21.15.6:0/1712164195 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180b5070 con 0x7f0b2014d7d0 2024-04-26T00:52:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1d59a640 1 -- 172.21.15.6:0/1712164195 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0b180a8a30 con 0x7f0b2014d7d0 2024-04-26T00:52:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.166+0000 7f0b1d59a640 1 -- 172.21.15.6:0/1712164195 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180a8e20 con 0x7f0b2014d7d0 2024-04-26T00:52:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/1712164195 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 msgr2=0x7f0b2014fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- 172.21.15.6:0/1712164195 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009870 tx=0x7f0b1801ed30 comp rx=0 tx=0).stop 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/1712164195 shutdown_connections 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- 172.21.15.6:0/1712164195 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b2014fbc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- 172.21.15.6:0/1712164195 >> v2:172.21.15.188:3300/0 conn(0x7f0b200abd20 0x7f0b201456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/1712164195 >> 172.21.15.6:0/1712164195 conn(0x7f0b200bacf0 msgr2=0x7f0b200bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/1712164195 shutdown_connections 2024-04-26T00:52:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/1712164195 wait complete. 2024-04-26T00:52:25.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 Processor -- start 2024-04-26T00:52:25.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- start start 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2006c410 0x7f0b2014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b200abd20 0x7f0b201414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20145bf0 con 0x7f0b2006c410 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0b200ac7a0 con 0x7f0b200abd20 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f0b20149bd0 con 0x7f0b2014d7d0 2024-04-26T00:52:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38588/0 (socket says 172.21.15.6:38588) 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/2033578405 learned_addr learned my addr 172.21.15.6:0/2033578405 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1e59c640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2006c410 0x7f0b2014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1dd9b640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b200abd20 0x7f0b201414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/2033578405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b200abd20 msgr2=0x7f0b201414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b200abd20 0x7f0b201414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2006c410 msgr2=0x7f0b2014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2006c410 0x7f0b2014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 -- 172.21.15.6:0/2033578405 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b20073210 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b1ed9d640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b1801c960 tx=0x7f0b1801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180b5070 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0b180b0ba0 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b201495a0 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180bb410 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.170+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2014b130 con 0x7f0b2014d7d0 2024-04-26T00:52:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2006db70 con 0x7f0b2014d7d0 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 13) ==== 130548+0+0 (secure 0 0 0) 0x7f0b180b9030 con 0x7f0b2014d7d0 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 4 mgrc handle_mgr_map Got map version 13 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 4 mgrc reconnect No active mgr available yet 2024-04-26T00:52:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.174+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f0b1815fc50 con 0x7f0b2014d7d0 2024-04-26T00:52:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.178+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0b18018890 con 0x7f0b2014d7d0 2024-04-26T00:52:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 14) ==== 130675+0+0 (secure 0 0 0) 0x7f0b1812c180 con 0x7f0b2014d7d0 2024-04-26T00:52:25.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-26T00:52:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 4 mgrc handle_mgr_map Got map version 14 2024-04-26T00:52:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.290+0000 7f0b0effd640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 0x7f0b000a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.294+0000 7f0b1e59c640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 0x7f0b000a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.294+0000 7f0b1e59c640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 0x7f0b000a0c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001810 tx=0x7f0b14009040 comp rx=0 tx=0).ready entity=mgr.4589 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.342+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b201dde70 con 0x7f0b2014d7d0 2024-04-26T00:52:25.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b0effd640 1 -- 172.21.15.6:0/2033578405 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+14651 (secure 0 0 0) 0x7f0b18137060 con 0x7f0b2014d7d0 2024-04-26T00:52:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-04-26T00:52:25.354 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"67c57dbc-0204-4fdf-9da5-917e1a66c836","created":"2024-04-26T00:50:17.375304+0000","modified":"2024-04-26T00:52:24.267006+0000","last_up_change":"2024-04-26T00:50:26.612800+0000","last_in_change":"2024-04-26T00:50:18.615769+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T00:50:28.326359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T00:50:33.296137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T00:50:37.659451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T00:50:38.192325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d96861c-0189-4a71-b899-1c1c734ac14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6801","nonce":1790946182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6803","nonce":1790946182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6807","nonce":1790946182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1790946182},{"type":"v1","addr":"172.21.15.6:6805","nonce":1790946182}]},"public_addr":"172.21.15.6:6801/1790946182","cluster_addr":"172.21.15.6:6803/1790946182","heartbeat_back_addr":"172.21.15.6:6807/1790946182","heartbeat_front_addr":"172.21.15.6:6805/1790946182","state":["exists","up"]},{"osd":1,"uuid":"135a11ee-8193-4d19-8131-ff670741a1d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6801","nonce":635512805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6803","nonce":635512805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6807","nonce":635512805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":635512805},{"type":"v1","addr":"172.21.15.188:6805","nonce":635512805}]},"public_addr":"172.21.15.188:6801/635512805","cluster_addr":"172.21.15.188:6803/635512805","heartbeat_back_addr":"172.21.15.188:6807/635512805","heartbeat_front_addr":"172.21.15.188:6805/635512805","state":["exists","up"]},{"osd":2,"uuid":"da9ff617-5bf7-4c67-ab53-42edca7d24a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6809","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6811","nonce":1913368330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6814","nonce":1913368330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6822","nonce":1913368330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":1913368330},{"type":"v1","addr":"172.21.15.188:6818","nonce":1913368330}]},"public_addr":"172.21.15.188:6811/1913368330","cluster_addr":"172.21.15.188:6814/1913368330","heartbeat_back_addr":"172.21.15.188:6822/1913368330","heartbeat_front_addr":"172.21.15.188:6818/1913368330","state":["exists","up"]},{"osd":3,"uuid":"92e37cac-6413-45ff-8912-5aa5cf9b15ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6810","nonce":408195122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6813","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6815","nonce":408195122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6821","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6823","nonce":408195122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6817","nonce":408195122},{"type":"v1","addr":"172.21.15.188:6819","nonce":408195122}]},"public_addr":"172.21.15.188:6810/408195122","cluster_addr":"172.21.15.188:6815/408195122","heartbeat_back_addr":"172.21.15.188:6823/408195122","heartbeat_front_addr":"172.21.15.188:6819/408195122","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:23.861909+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.147498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.194551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T00:50:24.247831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]},{"pgid":"4.25","mappings":[{"from":0,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/207881962":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/1514612866":"2024-04-27T00:52:16.526133+0000","172.21.15.6:6808/3851499451":"2024-04-27T00:52:16.526133+0000","172.21.15.6:6809/3851499451":"2024-04-27T00:52:16.526133+0000","172.21.15.6:6809/346340426":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/1596955840":"2024-04-27T00:52:16.526133+0000","172.21.15.6:0/3479549642":"2024-04-27T00:52:16.526133+0000","172.21.15.6:0/128203903":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/3711071451":"2024-04-27T00:52:16.526133+0000","172.21.15.6:0/2465359718":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/3217105978":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/2196907489":"2024-04-27T00:52:24.266949+0000","172.21.15.6:6808/346340426":"2024-04-27T00:52:24.266949+0000","172.21.15.6:0/1763034794":"2024-04-27T00:52:24.266949+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 10 mgrc shutdown 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 msgr2=0x7f0b000a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 0x7f0b000a0c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001810 tx=0x7f0b14009040 comp rx=0 tx=0).stop 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 msgr2=0x7f0b201de350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b1801c960 tx=0x7f0b1801bad0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 shutdown_connections 2024-04-26T00:52:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b2014d7d0 0x7f0b201de350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b200abd20 0x7f0b201414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f0b0009e830 0x7f0b000a0c20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 --2- 172.21.15.6:0/2033578405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2006c410 0x7f0b2014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 >> 172.21.15.6:0/2033578405 conn(0x7f0b200bacf0 msgr2=0x7f0b20146500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 shutdown_connections 2024-04-26T00:52:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.346+0000 7f0b24994640 1 -- 172.21.15.6:0/2033578405 wait complete. 2024-04-26T00:52:25.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T00:52:25.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 Processor -- start 2024-04-26T00:52:25.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 -- start start 2024-04-26T00:52:25.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 0x7f86580719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 0x7f865814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8658071f20 con 0x7f86581446e0 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f86580a8250 con 0x7f865814d8e0 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f865dd1e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8658070d20 con 0x7f865806bb10 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f8656ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86581446e0 0x7f8658144b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45354/0 (socket says 172.21.15.6:45354) 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f8657fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 0x7f865814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86577fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 0x7f86580719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f8656ffd640 1 -- 172.21.15.6:0/4225647454 learned_addr learned my addr 172.21.15.6:0/4225647454 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86577fe640 1 -- 172.21.15.6:0/4225647454 >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 msgr2=0x7f865814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86577fe640 1 --2- 172.21.15.6:0/4225647454 >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 0x7f865814fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86577fe640 1 -- 172.21.15.6:0/4225647454 >> v1:172.21.15.6:6789/0 conn(0x7f86581446e0 legacy=0x7f8658144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86577fe640 1 -- 172.21.15.6:0/4225647454 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658145580 con 0x7f865806bb10 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f86567fc640 1 -- 172.21.15.6:0/4225647454 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101337636 0 0) 0x7f8658071f20 con 0x7f86581446e0 2024-04-26T00:52:25.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.482+0000 7f8657fff640 1 --2- 172.21.15.6:0/4225647454 >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 0x7f865814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:25.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86577fe640 1 --2- 172.21.15.6:0/4225647454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 0x7f86580719e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097c0 tx=0x7f864c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b5e15d5ae706e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86567fc640 1 -- 172.21.15.6:0/4225647454 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c0ab610 con 0x7f865806bb10 2024-04-26T00:52:25.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86567fc640 1 -- 172.21.15.6:0/4225647454 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f864c0b0070 con 0x7f865806bb10 2024-04-26T00:52:25.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86567fc640 1 -- 172.21.15.6:0/4225647454 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c0ab9f0 con 0x7f865806bb10 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/4225647454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 msgr2=0x7f86580719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- 172.21.15.6:0/4225647454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 0x7f86580719e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097c0 tx=0x7f864c01c3f0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/4225647454 shutdown_connections 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- 172.21.15.6:0/4225647454 >> v2:172.21.15.6:3300/0 conn(0x7f865814d8e0 0x7f865814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- 172.21.15.6:0/4225647454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f865806bb10 0x7f86580719e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/4225647454 >> 172.21.15.6:0/4225647454 conn(0x7f865806e400 msgr2=0x7f865806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/4225647454 shutdown_connections 2024-04-26T00:52:25.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/4225647454 wait complete. 2024-04-26T00:52:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 Processor -- start 2024-04-26T00:52:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- start start 2024-04-26T00:52:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 0x7f8658147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 0x7f865814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f86580706a0 con 0x7f865814d8e0 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8658070820 con 0x7f865806bb10 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f8658152a30 con 0x7f86581446e0 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8656ffd640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 0x7f865814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45102/0 (socket says 172.21.15.6:45102) 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 -- 172.21.15.6:0/1445373734 learned_addr learned my addr 172.21.15.6:0/1445373734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86577fe640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 0x7f8658147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 -- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 msgr2=0x7f865814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 0x7f865814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 -- 172.21.15.6:0/1445373734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 msgr2=0x7f8658147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 0x7f8658147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 -- 172.21.15.6:0/1445373734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86581481c0 con 0x7f865814d8e0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f86577fe640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 0x7f8658147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8656ffd640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 0x7f865814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f8657fff640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8650009e00 tx=0x7f865000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650018020 con 0x7f865814d8e0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8650014480 con 0x7f865814d8e0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650014890 con 0x7f865814d8e0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.486+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8658148480 con 0x7f865814d8e0 2024-04-26T00:52:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865814c240 con 0x7f865814d8e0 2024-04-26T00:52:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865806db70 con 0x7f865814d8e0 2024-04-26T00:52:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) ==== 130675+0+0 (secure 0 0 0) 0x7f865001b020 con 0x7f865814d8e0 2024-04-26T00:52:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 4 mgrc handle_mgr_map Got map version 14 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 0x7f864409b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f86577fe640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 0x7f864409b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f86500c3710 con 0x7f865814d8e0 2024-04-26T00:52:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.490+0000 7f86577fe640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 0x7f864409b650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f864c0af000 tx=0x7f864c008040 comp rx=0 tx=0).ready entity=mgr.4589 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.494+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8650022020 con 0x7f865814d8e0 2024-04-26T00:52:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.686+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8658140170 con 0x7f865814d8e0 2024-04-26T00:52:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f863ffff640 1 -- 172.21.15.6:0/1445373734 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f8658140170 con 0x7f865814d8e0 2024-04-26T00:52:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T00:52:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f865dd1e640 10 mgrc shutdown 2024-04-26T00:52:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 msgr2=0x7f864409b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 0x7f864409b650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f864c0af000 tx=0x7f864c008040 comp rx=0 tx=0).stop 2024-04-26T00:52:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 msgr2=0x7f865814af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.694+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8650009e00 tx=0x7f865000c490 comp rx=0 tx=0).stop 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 shutdown_connections 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f8644099190 0x7f864409b650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865814d8e0 0x7f865814af60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86581446e0 0x7f865814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 --2- 172.21.15.6:0/1445373734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f865806bb10 0x7f8658147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 >> 172.21.15.6:0/1445373734 conn(0x7f865806e400 msgr2=0x7f865814fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 shutdown_connections 2024-04-26T00:52:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.698+0000 7f865dd1e640 1 -- 172.21.15.6:0/1445373734 wait complete. 2024-04-26T00:52:25.707 INFO:tasks.ceph.mds.b.smithi188.stderr: -906> 2024-04-26T00:50:45.816+0000 7fe7b01ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T00:52:25.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T00:52:25.744 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 Processor -- start 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 -- start start 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 0x7ffa680a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 0x7ffa68144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680b8560 con 0x7ffa68071360 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680a9a40 con 0x7ffa68071b00 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa6dacb640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680a9d00 con 0x7ffa680b8180 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa67fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 0x7ffa680a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa67fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45110/0 (socket says 172.21.15.6:45110) 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa67fff640 1 -- 172.21.15.6:0/3625395227 learned_addr learned my addr 172.21.15.6:0/3625395227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa66ffd640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 0x7ffa68144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 -- 172.21.15.6:0/3625395227 >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 msgr2=0x7ffa68144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 0x7ffa68144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 -- 172.21.15.6:0/3625395227 >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 msgr2=0x7ffa68144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa677fe640 1 -- 172.21.15.6:0/3625395227 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680a7860 con 0x7ffa680b8180 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa67fff640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.826+0000 7ffa66ffd640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 0x7ffa68144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa677fe640 1 --2- 172.21.15.6:0/3625395227 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 0x7ffa680a91f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b8830 tx=0x7ffa5801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1741a7cd51d90369 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa667fc640 1 -- 172.21.15.6:0/3625395227 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580b1070 con 0x7ffa680b8180 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa667fc640 1 -- 172.21.15.6:0/3625395227 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffa580ac640 con 0x7ffa680b8180 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa667fc640 1 -- 172.21.15.6:0/3625395227 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580aca30 con 0x7ffa680b8180 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- 172.21.15.6:0/3625395227 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 msgr2=0x7ffa680a91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/3625395227 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 0x7ffa680a91f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b8830 tx=0x7ffa5801c460 comp rx=0 tx=0).stop 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- 172.21.15.6:0/3625395227 shutdown_connections 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.6:3300/0 conn(0x7ffa68071360 0x7ffa68144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/3625395227 >> v2:172.21.15.188:3300/0 conn(0x7ffa68071b00 0x7ffa68144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/3625395227 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa680b8180 0x7ffa680a91f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- 172.21.15.6:0/3625395227 >> 172.21.15.6:0/3625395227 conn(0x7ffa6806f1f0 msgr2=0x7ffa6806f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- 172.21.15.6:0/3625395227 shutdown_connections 2024-04-26T00:52:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- 172.21.15.6:0/3625395227 wait complete. 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 Processor -- start 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.830+0000 7ffa6dacb640 1 -- start start 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 0x7ffa6814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6806c3c0 con 0x7ffa68071b00 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6806c240 con 0x7ffa680b8180 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6806c540 con 0x7ffa68071360 2024-04-26T00:52:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45114/0 (socket says 172.21.15.6:45114) 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 -- 172.21.15.6:0/579846537 learned_addr learned my addr 172.21.15.6:0/579846537 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:38622/0 (socket says 172.21.15.6:38622) 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa67fff640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 0x7ffa6814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 -- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 msgr2=0x7ffa680b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 -- 172.21.15.6:0/579846537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 msgr2=0x7ffa6814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 0x7ffa6814afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 -- 172.21.15.6:0/579846537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680a8f50 con 0x7ffa68071b00 2024-04-26T00:52:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa677fe640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa67fff640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 0x7ffa6814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa66ffd640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000cf60 tx=0x7ffa5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5001a070 con 0x7ffa68071b00 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffa5000d840 con 0x7ffa68071b00 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000dc30 con 0x7ffa68071b00 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6813f930 con 0x7ffa68071b00 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa68147550 con 0x7ffa68071b00 2024-04-26T00:52:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6806db70 con 0x7ffa68071b00 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) ==== 130675+0+0 (secure 0 0 0) 0x7ffa5001d070 con 0x7ffa68071b00 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.834+0000 7ffa5ffff640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 4 mgrc handle_mgr_map Got map version 14 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 0x7ffa4809b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa677fe640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 0x7ffa4809b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5313+0+0 (secure 0 0 0) 0x7ffa500c3210 con 0x7ffa68071b00 2024-04-26T00:52:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa677fe640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 0x7ffa4809b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffa580ae000 tx=0x7ffa580a6070 comp rx=0 tx=0).ready entity=mgr.4589 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:25.838+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ffa50093ab0 con 0x7ffa68071b00 2024-04-26T00:52:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.030+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffa680b4130 con 0x7ffa68071b00 2024-04-26T00:52:26.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.694+0000 7ffa5ffff640 1 -- 172.21.15.6:0/579846537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7ffa50097db0 con 0x7ffa68071b00 2024-04-26T00:52:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 10 mgrc shutdown 2024-04-26T00:52:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 msgr2=0x7ffa4809b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:26.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 0x7ffa4809b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffa580ae000 tx=0x7ffa580a6070 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 msgr2=0x7ffa6814aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000cf60 tx=0x7ffa5000cf90 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 shutdown_connections 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa680b8180 0x7ffa6814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7ffa48099190 0x7ffa4809b650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa68071b00 0x7ffa6814aaa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 --2- 172.21.15.6:0/579846537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa68071360 0x7ffa680b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 >> 172.21.15.6:0/579846537 conn(0x7ffa6806f1f0 msgr2=0x7ffa6806cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 shutdown_connections 2024-04-26T00:52:26.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.698+0000 7ffa6dacb640 1 -- 172.21.15.6:0/579846537 wait complete. 2024-04-26T00:52:26.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T00:52:26.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.850+0000 7f966e857640 1 Processor -- start 2024-04-26T00:52:26.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.850+0000 7f966e857640 1 -- start start 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.850+0000 7f966e857640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9668138330 0x7f966806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.850+0000 7f966e857640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96680ac3b0 0x7f966814f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9668137a60 con 0x7f96681375b0 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f96680a8240 con 0x7f96680ac3b0 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9668137d20 con 0x7f9668138330 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96680ac3b0 0x7f966814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96680ac3b0 0x7f966814f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56104/0 (socket says 172.21.15.6:56104) 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 -- 172.21.15.6:0/3192441542 learned_addr learned my addr 172.21.15.6:0/3192441542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f9667fff640 1 --2- 172.21.15.6:0/3192441542 >> v2:172.21.15.188:3300/0 conn(0x7f9668138330 0x7f966806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 -- 172.21.15.6:0/3192441542 >> v2:172.21.15.188:3300/0 conn(0x7f9668138330 msgr2=0x7f966806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 --2- 172.21.15.6:0/3192441542 >> v2:172.21.15.188:3300/0 conn(0x7f9668138330 0x7f966806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 -- 172.21.15.6:0/3192441542 >> v1:172.21.15.188:6789/0 conn(0x7f96681375b0 legacy=0x7f966806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:26.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 -- 172.21.15.6:0/3192441542 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966806bc10 con 0x7f96680ac3b0 2024-04-26T00:52:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966cdf4640 1 --2- 172.21.15.6:0/3192441542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96680ac3b0 0x7f966814f800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f96680aa4e0 tx=0x7f966001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171097cfa87bab70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f9666ffd640 1 -- 172.21.15.6:0/3192441542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96600ac020 con 0x7f96680ac3b0 2024-04-26T00:52:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f9666ffd640 1 -- 172.21.15.6:0/3192441542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f96600a6430 con 0x7f96680ac3b0 2024-04-26T00:52:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f9666ffd640 1 -- 172.21.15.6:0/3192441542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96600a6820 con 0x7f96680ac3b0 2024-04-26T00:52:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- 172.21.15.6:0/3192441542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96680ac3b0 msgr2=0x7f966814f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 --2- 172.21.15.6:0/3192441542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96680ac3b0 0x7f966814f800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f96680aa4e0 tx=0x7f966001c870 comp rx=0 tx=0).stop 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- 172.21.15.6:0/3192441542 shutdown_connections 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 --2- 172.21.15.6:0/3192441542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96680ac3b0 0x7f966814f800 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 --2- 172.21.15.6:0/3192441542 >> v2:172.21.15.188:3300/0 conn(0x7f9668138330 0x7f966806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- 172.21.15.6:0/3192441542 >> 172.21.15.6:0/3192441542 conn(0x7f966806e100 msgr2=0x7f966806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- 172.21.15.6:0/3192441542 shutdown_connections 2024-04-26T00:52:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.854+0000 7f966e857640 1 -- 172.21.15.6:0/3192441542 wait complete. 2024-04-26T00:52:26.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 Processor -- start 2024-04-26T00:52:26.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- start start 2024-04-26T00:52:26.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96681375b0 0x7f96681ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 0x7f96681de110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96681528f0 con 0x7f96681375b0 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9668152770 con 0x7f9668138330 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f9668152a70 con 0x7f96680ac3b0 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:32960/0 (socket says 172.21.15.6:32960) 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f96677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96681375b0 0x7f96681ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 -- 172.21.15.6:0/3050517824 learned_addr learned my addr 172.21.15.6:0/3050517824 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966cdf4640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 0x7f96681de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 -- 172.21.15.6:0/3050517824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 msgr2=0x7f96681de110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:26.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 0x7f96681de110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 -- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96681375b0 msgr2=0x7f96681ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96681375b0 0x7f96681ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 -- 172.21.15.6:0/3050517824 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96681453e0 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966cdf4640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 0x7f96681de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9667fff640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f965800d5f0 tx=0x7f965800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580125f0 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9658019070 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96681deab0 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580129d0 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96680a7b20 con 0x7f96680ac3b0 2024-04-26T00:52:26.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.858+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966806db70 con 0x7f96680ac3b0 2024-04-26T00:52:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 14) ==== 130675+0+0 (secure 0 0 0) 0x7f9658012b70 con 0x7f96680ac3b0 2024-04-26T00:52:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-26T00:52:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 4 mgrc handle_mgr_map Got map version 14 2024-04-26T00:52:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 0x7f965409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 5313+0+0 (secure 0 0 0) 0x7f96580c32a0 con 0x7f96680ac3b0 2024-04-26T00:52:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f96677fe640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 0x7f965409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:26.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.862+0000 7f96677fe640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 0x7f965409b680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f96680b9220 tx=0x7f965c007e40 comp rx=0 tx=0).ready entity=mgr.4589 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:26.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:26.866+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f96580940c0 con 0x7f96680ac3b0 2024-04-26T00:52:27.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.030+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96680aac10 con 0x7f96680ac3b0 2024-04-26T00:52:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.306+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 15) ==== 130883+0+0 (secure 0 0 0) 0x7f965808ffa0 con 0x7f96680ac3b0 2024-04-26T00:52:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.306+0000 7f9664ff9640 20 mgrc handle_mgr_map mgrmap(e 15) 2024-04-26T00:52:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.306+0000 7f9664ff9640 4 mgrc handle_mgr_map Got map version 15 2024-04-26T00:52:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.306+0000 7f9664ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:27.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.714+0000 7f9664ff9640 1 -- 172.21.15.6:0/3050517824 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) ==== 181+0+0 (secure 0 0 0) 0x7f965808c8d0 con 0x7f96680ac3b0 2024-04-26T00:52:27.725 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-04-26T00:52:27.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.718+0000 7f966e857640 10 mgrc shutdown 2024-04-26T00:52:27.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 msgr2=0x7f965409b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 0x7f965409b680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f96680b9220 tx=0x7f965c007e40 comp rx=0 tx=0).stop 2024-04-26T00:52:27.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 msgr2=0x7f96681361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f965800d5f0 tx=0x7f965800dab0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 shutdown_connections 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9668138330 0x7f96681de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f96540991c0 0x7f965409b680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96681375b0 0x7f96681ddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 --2- 172.21.15.6:0/3050517824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f96680ac3b0 0x7f96681361d0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f965800d5f0 tx=0x7f965800dab0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 >> 172.21.15.6:0/3050517824 conn(0x7f966806e100 msgr2=0x7f966813a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 shutdown_connections 2024-04-26T00:52:27.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.722+0000 7f966e857640 1 -- 172.21.15.6:0/3050517824 wait complete. 2024-04-26T00:52:27.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T00:52:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 Processor -- start 2024-04-26T00:52:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 -- start start 2024-04-26T00:52:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6bac0a8250 0x7f6bac143630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac0b6050 con 0x7f6bac143b70 2024-04-26T00:52:27.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6bac0b62f0 con 0x7f6bac0a8250 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb3e4b640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac0a7930 con 0x7f6bac072df0 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:32966/0 (socket says 172.21.15.6:32966) 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 -- 172.21.15.6:0/332875091 learned_addr learned my addr 172.21.15.6:0/332875091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb13e6640 1 --2- 172.21.15.6:0/332875091 >> v2:172.21.15.188:3300/0 conn(0x7f6bac0a8250 0x7f6bac143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 -- 172.21.15.6:0/332875091 >> v2:172.21.15.188:3300/0 conn(0x7f6bac0a8250 msgr2=0x7f6bac143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 --2- 172.21.15.6:0/332875091 >> v2:172.21.15.188:3300/0 conn(0x7f6bac0a8250 0x7f6bac143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 -- 172.21.15.6:0/332875091 >> v1:172.21.15.188:6789/0 conn(0x7f6bac143b70 legacy=0x7f6bac06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.878+0000 7f6bb1be7640 1 -- 172.21.15.6:0/332875091 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac0a7db0 con 0x7f6bac072df0 2024-04-26T00:52:27.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 --2- 172.21.15.6:0/332875091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009e50 tx=0x7f6ba801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8381411627ad64cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb0be5640 1 -- 172.21.15.6:0/332875091 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a64f0 con 0x7f6bac072df0 2024-04-26T00:52:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb0be5640 1 -- 172.21.15.6:0/332875091 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ba80a6690 con 0x7f6bac072df0 2024-04-26T00:52:27.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb0be5640 1 -- 172.21.15.6:0/332875091 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a6a80 con 0x7f6bac072df0 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/332875091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 msgr2=0x7f6bac0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/332875091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009e50 tx=0x7f6ba801c8f0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/332875091 shutdown_connections 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/332875091 >> v2:172.21.15.188:3300/0 conn(0x7f6bac0a8250 0x7f6bac143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/332875091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac072df0 0x7f6bac0b41f0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009e50 tx=0x7f6ba801c8f0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/332875091 >> 172.21.15.6:0/332875091 conn(0x7f6bac06cb40 msgr2=0x7f6bac06cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/332875091 shutdown_connections 2024-04-26T00:52:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/332875091 wait complete. 2024-04-26T00:52:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 Processor -- start 2024-04-26T00:52:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- start start 2024-04-26T00:52:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 0x7f6bac1de210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 0x7f6bac1de750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0b75b0 con 0x7f6bac0a6740 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0b7430 con 0x7f6bac143b70 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb3e4b640 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac150640 con 0x7f6bac0a8250 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb23e8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 0x7f6bac1de750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:32972/0 (socket says 172.21.15.6:32972) 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 -- 172.21.15.6:0/4233889102 learned_addr learned my addr 172.21.15.6:0/4233889102 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb13e6640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 0x7f6bac1de210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 -- 172.21.15.6:0/4233889102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 msgr2=0x7f6bac1de210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 0x7f6bac1de210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 -- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 msgr2=0x7f6bac1de750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 0x7f6bac1de750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb1be7640 1 -- 172.21.15.6:0/4233889102 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac071d70 con 0x7f6bac0a8250 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb13e6640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 0x7f6bac1de210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.882+0000 7f6bb23e8640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 0x7f6bac1de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb1be7640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ba801a520 tx=0x7f6ba8019690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80bf070 con 0x7f6bac0a8250 2024-04-26T00:52:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ba80091d0 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac070270 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a6aa0 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac14ae70 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bac06db70 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 15) ==== 130883+0+0 (secure 0 0 0) 0x7f6ba80c2070 con 0x7f6bac0a8250 2024-04-26T00:52:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 20 mgrc handle_mgr_map mgrmap(e 15) 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 4 mgrc handle_mgr_map Got map version 15 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 0x7f6b9009b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb13e6640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 0x7f6b9009b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T00:52:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 4875+0+0 (secure 0 0 0) 0x7f6ba815c370 con 0x7f6bac0a8250 2024-04-26T00:52:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.886+0000 7f6bb13e6640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 0x7f6b9009b890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6bac071cd0 tx=0x7f6b9c008040 comp rx=0 tx=0).ready entity=mgr.4589 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T00:52:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:27.890+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6ba8016600 con 0x7f6bac0a8250 2024-04-26T00:52:28.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.058+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6bac0723a0 con 0x7f6bac0a8250 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.742+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mgrmap(e 16) ==== 130939+0+0 (secure 0 0 0) 0x7f6ba8128fe0 con 0x7f6bac0a8250 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.742+0000 7f6ba27fc640 20 mgrc handle_mgr_map mgrmap(e 16) 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.742+0000 7f6ba27fc640 4 mgrc handle_mgr_map Got map version 16 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.742+0000 7f6ba27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.742+0000 7f6ba27fc640 1 -- 172.21.15.6:0/4233889102 <== mon.2 v2:172.21.15.6:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) ==== 169+0+0 (secure 0 0 0) 0x7f6ba815ea80 con 0x7f6bac0a8250 2024-04-26T00:52:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 10 mgrc shutdown 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 msgr2=0x7f6b9009b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 0x7f6b9009b890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6bac071cd0 tx=0x7f6b9c008040 comp rx=0 tx=0).stop 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 msgr2=0x7f6bac14a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ba801a520 tx=0x7f6ba8019690 comp rx=0 tx=0).stop 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 shutdown_connections 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:6808/1381655781,v1:172.21.15.6:6809/1381655781] conn(0x7f6b900993d0 0x7f6b9009b890 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bac0a6740 0x7f6bac1de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bac143b70 0x7f6bac1de210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 --2- 172.21.15.6:0/4233889102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bac0a8250 0x7f6bac14a930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T00:52:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 >> 172.21.15.6:0/4233889102 conn(0x7f6bac06cb40 msgr2=0x7f6bac13d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:52:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 shutdown_connections 2024-04-26T00:52:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-04-26T00:52:28.746+0000 7f6bb3e4b640 1 -- 172.21.15.6:0/4233889102 wait complete. 2024-04-26T00:52:28.780 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T00:52:28.781 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T00:52:28.781 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:28.792 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T00:52:28.792 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T00:52:28.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:28.851 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T00:52:28.851 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T00:52:28.851 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:28.866 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T00:52:28.866 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T00:52:28.866 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T00:52:28.867 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:28.964 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T00:52:28.965 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T00:52:28.965 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.036 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T00:52:29.037 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T00:52:29.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.126 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T00:52:29.126 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T00:52:29.126 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.211 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T00:52:29.211 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T00:52:29.212 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T00:52:29.212 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.247 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T00:52:29.247 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T00:52:29.247 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.282 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T00:52:29.282 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-04-26T00:52:29.282 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.352 INFO:tasks.ceph.mgr.z:Stopped 2024-04-26T00:52:29.352 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T00:52:29.352 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T00:52:29.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.377 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T00:52:29.377 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T00:52:29.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.445 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T00:52:29.445 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T00:52:29.445 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:52:29.461 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T00:52:29.462 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T00:52:29.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-04-26T00:52:29.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-04-26T00:52:29.504 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T00:52:30.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:52:30.130 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T00:52:30.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:52:30.477 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T00:52:30.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:52:30.671 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T00:52:30.837 INFO:tasks.ceph:Archiving mon data... 2024-04-26T00:52:30.838 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/data/mon.a.tgz 2024-04-26T00:52:30.839 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-04-26T00:52:30.845 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.XbR1WYRiZR 2024-04-26T00:52:30.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XbR1WYRiZR 2024-04-26T00:52:31.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.XbR1WYRiZR 2024-04-26T00:52:31.128 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.XbR1WYRiZR is 925KB 2024-04-26T00:52:31.199 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.XbR1WYRiZR 2024-04-26T00:52:31.204 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/data/mon.c.tgz 2024-04-26T00:52:31.205 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-04-26T00:52:31.252 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.v9JjlIMH9O 2024-04-26T00:52:31.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.v9JjlIMH9O 2024-04-26T00:52:31.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.v9JjlIMH9O 2024-04-26T00:52:31.601 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.v9JjlIMH9O is 1MB 2024-04-26T00:52:31.681 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.v9JjlIMH9O 2024-04-26T00:52:31.687 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/data/mon.b.tgz 2024-04-26T00:52:31.687 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-04-26T00:52:31.693 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.Qyn9iyod19 2024-04-26T00:52:31.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Qyn9iyod19 2024-04-26T00:52:31.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.Qyn9iyod19 2024-04-26T00:52:32.033 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.Qyn9iyod19 is 1MB 2024-04-26T00:52:32.155 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.Qyn9iyod19 2024-04-26T00:52:32.161 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T00:52:32.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T00:52:32.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T00:52:32.226 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T00:52:32.268 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T00:52:32.268 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T00:52:32.270 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi006/crash 2024-04-26T00:52:32.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T00:52:32.285 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi188/crash 2024-04-26T00:52:32.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T00:52:32.323 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T00:52:32.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:32.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:32.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:32.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T00:52:32.464 INFO:tasks.ceph:Compressing logs... 2024-04-26T00:52:32.464 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T00:52:32.467 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T00:52:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24234.log 2024-04-26T00:52:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24470.log 2024-04-26T00:52:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24366.log 2024-04-26T00:52:32.494 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24234.log.gz 2024-04-26T00:52:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24049.log 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24366.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.24470.log.gz -5 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23958.log 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25747.log 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24366.log.gz 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.23958.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24049.log.gz 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24262.log 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25148.log 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23958.log.gz 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25747.log: /var/log/ceph/ceph-client.admin.24262.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.25747.log.gz 2024-04-26T00:52:32.495 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T00:52:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25252.log 2024-04-26T00:52:32.499 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24262.log.gz 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25148.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25304.log 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.25148.log.gz 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25252.log.gz 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25044.log 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23900.log 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24600.log 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25304.log.gz 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.23900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24206.log 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25044.log.gz 2024-04-26T00:52:32.500 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23900.log.gz 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25174.log 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25096.log 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24600.log.gz 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25174.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.24206.log.gz /var/log/ceph/ceph-client.admin.24392.log 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.25174.log.gz 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24574.log 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26234.log 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24392.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.25096.log.gz 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24574.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24392.log.gz 2024-04-26T00:52:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25936.log 2024-04-26T00:52:32.502 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24574.log.gz 2024-04-26T00:52:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25356.log 2024-04-26T00:52:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24782.log 2024-04-26T00:52:32.520 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.26234.log.gz 2024-04-26T00:52:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25903.log 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25936.log.gz 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24496.log/var/log/ceph/ceph-client.admin.24782.log: 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.25356.log.gz 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.25903.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.24782.log.gz 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24688.log 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.25903.log.gz 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24496.log.gz 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25823.log 2024-04-26T00:52:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26208.log 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25823.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24688.log.gz 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25495.log 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.25823.log.gz 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25330.log 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24683.log 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25495.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26208.log.gz 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.25495.log.gz 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24791.log 2024-04-26T00:52:32.522 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25330.log.gz 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24914.log 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24683.log.gz 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25070.log 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20152.log 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24791.log.gz 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24914.log: /var/log/ceph/ceph-client.admin.25070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24888.log 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24914.log.gz 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25070.log.gz 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.20152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26119.log 2024-04-26T00:52:32.523 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20152.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25772.log 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24888.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24154.log 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.26119.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25278.log 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.25772.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26171.log 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24154.log: /var/log/ceph/ceph-client.admin.25278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21646.log 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26171.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24154.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.25278.log.gz 2024-04-26T00:52:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23820.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26171.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.21646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24102.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24652.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.23820.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.21646.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24075.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.23820.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24102.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23875.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24652.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24794.log 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.23875.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24075.log.gz 2024-04-26T00:52:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24288.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23875.log.gz 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24794.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24794.log.gz 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25848.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24288.log.gz 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21511.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25848.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.25848.log.gz 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.21511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25018.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24689.log 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.21511.log.gz 2024-04-26T00:52:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25226.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.25018.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.24689.log: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21688.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24689.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.c.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.25226.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24940.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.21688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23926.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21688.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26093.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.23926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25200.log 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24940.log.gz 2024-04-26T00:52:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26093.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23926.log.gz 2024-04-26T00:52:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25519.log 2024-04-26T00:52:32.528 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26093.log.gz 2024-04-26T00:52:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T00:52:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25200.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T00:52:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25519.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.25200.log.gz 2024-04-26T00:52:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T00:52:32.535 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25519.log.gz 2024-04-26T00:52:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24522.log 2024-04-26T00:52:32.535 INFO:teuthology.orchestra.run.smithi006.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T00:52:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24023.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.24522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26145.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 89.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24023.log: 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24522.log.gz 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24023.log.gz 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24314.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25879.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26145.log.gz 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24340.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24314.log: /var/log/ceph/ceph-client.admin.25879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24626.log 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24314.log.gz 2024-04-26T00:52:32.536 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24418.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25879.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24340.log: /var/log/ceph/ceph-client.admin.24626.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24340.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24626.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24992.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24690.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24418.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25543.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24690.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24992.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24966.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24690.log.gz 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24180.log 2024-04-26T00:52:32.537 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.25543.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24548.log 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24966.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24444.log 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24180.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24128.log 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24548.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25591.log 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24444.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26067.log 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24128.log.gz 2024-04-26T00:52:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25122.log 2024-04-26T00:52:32.539 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.25591.log.gz 2024-04-26T00:52:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24786.log 2024-04-26T00:52:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.25122.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26067.log.gz 2024-04-26T00:52:32.539 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.25122.log.gz 2024-04-26T00:52:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.24786.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24786.log.gz 2024-04-26T00:52:32.543 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T00:52:32.543 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T00:52:32.543 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24053.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24053.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24053.log.gz 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24029.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.z.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.24029.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr: 84.5% 88.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mgr.z.log: -- replaced with /var/log/ceph/ceph-client.admin.24029.log.gz 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24005.log 2024-04-26T00:52:32.544 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T00:52:32.545 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.24005.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T00:52:32.545 INFO:teuthology.orchestra.run.smithi188.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24005.log.gz/var/log/ceph/ceph-mds.b.log: 2024-04-26T00:52:32.545 INFO:teuthology.orchestra.run.smithi188.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T00:52:32.545 INFO:teuthology.orchestra.run.smithi188.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T00:52:32.545 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24077.log 2024-04-26T00:52:32.546 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.24077.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24077.log.gz 2024-04-26T00:52:32.547 INFO:teuthology.orchestra.run.smithi188.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T00:52:32.549 INFO:teuthology.orchestra.run.smithi188.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.z.log.gz 2024-04-26T00:52:32.557 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T00:52:32.595 INFO:teuthology.orchestra.run.smithi188.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T00:52:32.607 INFO:teuthology.orchestra.run.smithi006.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T00:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T00:52:33.114 INFO:teuthology.orchestra.run.smithi188.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T00:52:33.136 INFO:teuthology.orchestra.run.smithi188.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T00:52:33.196 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T00:52:33.198 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-04-26T00:52:33.198 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m0.686s 2024-04-26T00:52:33.198 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m1.839s 2024-04-26T00:52:33.198 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.108s 2024-04-26T00:52:33.329 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T00:52:33.331 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-04-26T00:52:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m0.862s 2024-04-26T00:52:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m1.153s 2024-04-26T00:52:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.090s 2024-04-26T00:52:33.332 INFO:tasks.ceph:Archiving logs... 2024-04-26T00:52:33.332 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi006/log 2024-04-26T00:52:33.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T00:52:34.026 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi188/log 2024-04-26T00:52:34.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T00:52:36.516 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T00:52:36.625 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T00:52:36.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T00:52:36.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T00:52:36.696 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T00:52:36.705 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T00:52:36.705 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:52:36.709 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:52:36.719 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:52:36.719 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-04-26T00:52:36.719 INFO:teuthology.orchestra.run.smithi006.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 37 0.069 -1.789 0.579 2024-04-26T00:52:36.720 INFO:teuthology.orchestra.run.smithi006.stdout:*hv02.front.sepi 63.231.80.2 3 u 13 64 37 0.106 +0.798 0.921 2024-04-26T00:52:36.720 INFO:teuthology.orchestra.run.smithi006.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 37 0.078 +0.522 0.874 2024-04-26T00:52:36.720 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:52:36.724 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:52:36.724 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-04-26T00:52:36.725 INFO:teuthology.orchestra.run.smithi188.stdout:+hv01.front.sepi 67.205.162.81 3 u 10 64 37 0.090 -2.885 0.670 2024-04-26T00:52:36.725 INFO:teuthology.orchestra.run.smithi188.stdout:*hv02.front.sepi 63.231.80.2 3 u 15 64 37 0.110 -0.827 0.687 2024-04-26T00:52:36.725 INFO:teuthology.orchestra.run.smithi188.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 37 0.087 -1.013 0.649 2024-04-26T00:52:36.725 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T00:52:36.725 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T00:52:36.734 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T00:52:36.735 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T00:52:36.752 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T00:52:36.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T00:52:36.821 INFO:teuthology.task.internal:Duration was 706.552524 seconds 2024-04-26T00:52:36.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T00:52:36.835 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T00:52:36.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T00:52:36.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T00:52:36.876 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T00:52:36.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-04-26T00:52:36.877 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T00:52:36.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-04-26T00:52:36.930 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T00:52:36.940 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T00:52:36.940 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T00:52:36.974 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T00:52:37.012 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T00:52:37.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T00:52:37.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T00:52:37.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T00:52:37.123 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T00:52:37.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T00:52:37.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T00:52:37.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T00:52:37.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:52:37.183 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:52:37.191 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-04-26T00:52:37.196 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-04-26T00:52:37.263 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:52:37.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:52:37.268 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:52:37.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:52:37.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T00:52:37.320 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T00:52:37.321 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi006 2024-04-26T00:52:37.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T00:52:37.344 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673945/remote/smithi188 2024-04-26T00:52:37.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T00:52:37.373 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T00:52:37.373 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T00:52:37.390 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T00:52:37.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T00:52:37.428 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T00:52:37.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T00:52:37.458 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T00:52:37.459 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T00:52:37.461 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T00:52:37.465 INFO:teuthology.orchestra.run.smithi006.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 00:52 /home/ubuntu/cephtest 2024-04-26T00:52:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 00:52 /home/ubuntu/cephtest 2024-04-26T00:52:37.469 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T00:52:37.481 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T00:52:37.507 INFO:teuthology.run:Summary data: description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} duration: 706.5525240898132 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T00:52:37.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T00:52:37.615 INFO:teuthology.run:pass